2024-09-15T03:05:32.015 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T03:05:32.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T03:05:32.106 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248 branch: wip-bharath9-testing-2024-09-13-1444-quincy description: rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} email: skanta@redhat.com first_in_suite: false job_id: '7905248' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-bharath9-testing-2024-09-13-1444-quincy ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - MON_DOWN - mons down - mon down - out of quorum sha1: d75f23820806da622f561ee5ee7551015285993f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d75f23820806da622f561ee5ee7551015285993f kernel: hwe: true workunit: branch: wip-bharath9-testing-2024-09-13-1444-quincy sha1: d75f23820806da622f561ee5ee7551015285993f owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 2126 sha1: d75f23820806da622f561ee5ee7551015285993f sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath9-testing-2024-09-13-1444-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d75f23820806da622f561ee5ee7551015285993f targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - nvme_loop: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - cephadm.shell: mon.a: - stat -c '%u %g' /var/log/ceph | grep '167 167' - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - ceph orch ls --format yaml - ceph orch ls | grep '^osd ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_00:54:39 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T03:05:32.106 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa; will attempt to use it 2024-09-15T03:05:32.107 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d75f23820806da622f561ee5ee7551015285993f/qa/tasks 2024-09-15T03:05:32.107 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T03:05:32.108 INFO:teuthology.task.internal:Checking packages... 2024-09-15T03:05:32.129 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd75f23820806da622f561ee5ee7551015285993f' 2024-09-15T03:05:32.130 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T03:05:32.130 INFO:teuthology.packaging:ref: None 2024-09-15T03:05:32.130 INFO:teuthology.packaging:tag: None 2024-09-15T03:05:32.130 INFO:teuthology.packaging:branch: wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-15T03:05:32.130 INFO:teuthology.packaging:sha1: d75f23820806da622f561ee5ee7551015285993f 2024-09-15T03:05:32.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-bharath9-testing-2024-09-13-1444-quincy 2024-09-15T03:05:32.282 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1643-gd75f2382-1focal 2024-09-15T03:05:32.284 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T03:05:32.290 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T03:05:32.290 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T03:05:32.322 INFO:teuthology.task.internal:Saving configuration 2024-09-15T03:05:32.333 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T03:05:32.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T03:05:32.373 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 02:59:41.480910', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-15T03:05:32.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 02:59:41.478878', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-15T03:05:32.393 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T03:05:32.399 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-15T03:05:32.399 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-09-15T03:05:32.399 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T03:05:32.478 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8e2783ac0>, signals=[15]) 2024-09-15T03:05:32.478 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T03:05:32.484 INFO:teuthology.task.internal:Opening connections... 2024-09-15T03:05:32.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-09-15T03:05:32.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:05:32.581 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi104.front.sepia.ceph.com 2024-09-15T03:05:32.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:05:32.671 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T03:05:32.678 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-09-15T03:05:32.685 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-09-15T03:05:32.686 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-09-15T03:05:32.732 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2024-09-15T03:05:32.732 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="20.04" 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=focal 2024-09-15T03:05:32.733 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=focal 2024-09-15T03:05:32.734 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-09-15T03:05:32.759 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-09-15T03:05:32.766 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-09-15T03:05:32.767 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-09-15T03:05:32.813 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu" 2024-09-15T03:05:32.813 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-15T03:05:32.813 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu 2024-09-15T03:05:32.813 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian 2024-09-15T03:05:32.813 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-15T03:05:32.814 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="20.04" 2024-09-15T03:05:32.814 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T03:05:32.814 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T03:05:32.814 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T03:05:32.814 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T03:05:32.814 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=focal 2024-09-15T03:05:32.814 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=focal 2024-09-15T03:05:32.814 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-09-15T03:05:32.834 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T03:05:32.843 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T03:05:32.864 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T03:05:32.864 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-09-15T03:05:32.867 DEBUG:teuthology.orchestra.run.smithi104:> test '!' -e /home/ubuntu/cephtest 2024-09-15T03:05:32.873 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T03:05:32.960 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T03:05:32.960 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-09-15T03:05:32.964 DEBUG:teuthology.orchestra.run.smithi104:> test -z $(ls -A /var/lib/ceph) 2024-09-15T03:05:32.978 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T03:05:33.044 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T03:05:33.059 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-15T03:05:33.059 INFO:teuthology.task.kernel:normalize config orig: {'hwe': True} 2024-09-15T03:05:33.060 DEBUG:teuthology.task.kernel:normalized overrides {'mon.a': {'hwe': True}, 'mon.c': {'hwe': True}, 'mgr.y': {'hwe': True}, 'osd.0': {'hwe': True}, 'osd.1': {'hwe': True}, 'osd.2': {'hwe': True}, 'osd.3': {'hwe': True}, 'client.0': {'hwe': True}, 'ceph.rgw.foo.a': {'hwe': True}, 'node-exporter.a': {'hwe': True}, 'alertmanager.a': {'hwe': True}, 'mon.b': {'hwe': True}, 'mgr.x': {'hwe': True}, 'osd.4': {'hwe': True}, 'osd.5': {'hwe': True}, 'osd.6': {'hwe': True}, 'osd.7': {'hwe': True}, 'client.1': {'hwe': True}, 'prometheus.a': {'hwe': True}, 'grafana.a': {'hwe': True}, 'node-exporter.b': {'hwe': True}, 'ceph.iscsi.iscsi.a': {'hwe': True}} 2024-09-15T03:05:33.060 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro', 'hwe': True}, 'mon.b': {'kdb': 1, 'sha1': 'distro', 'hwe': True}}, timeout 300 2024-09-15T03:05:33.060 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T03:05:33.061 DEBUG:teuthology.orchestra.run.smithi104:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T03:05:33.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:05:33.066 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-15T03:05:33.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:05:33.067 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-15T03:05:33.073 INFO:teuthology.orchestra.run.smithi053.stdout:5.4.0-124-generic 2024-09-15T03:05:33.073 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.4.0-124-generic 2024-09-15T03:05:33.074 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-09-15T03:05:33.074 INFO:teuthology.orchestra.run.smithi104.stdout:5.4.0-124-generic 2024-09-15T03:05:33.075 INFO:teuthology.task.kernel:Running kernel on smithi104: 5.4.0-124-generic 2024-09-15T03:05:33.075 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get clean 2024-09-15T03:05:33.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-09-15T03:05:33.220 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-09-15T03:05:33.345 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-15T03:05:33.356 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-15T03:05:33.381 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-15T03:05:33.399 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-15T03:05:33.420 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-15T03:05:33.455 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-15T03:05:33.459 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-15T03:05:33.493 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-15T03:05:33.742 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-15T03:05:33.760 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-15T03:05:33.837 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-15T03:05:33.876 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-15T03:05:33.896 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-15T03:05:33.897 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-15T03:05:33.897 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-15T03:05:33.925 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-15T03:05:33.928 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-15T03:05:33.928 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-15T03:05:33.935 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,231 kB] 2024-09-15T03:05:33.940 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-15T03:05:33.945 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-15T03:05:33.947 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-15T03:05:33.947 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-15T03:05:33.948 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-15T03:05:33.948 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-15T03:05:33.953 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-15T03:05:33.957 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-15T03:05:33.958 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-15T03:05:33.959 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-15T03:05:33.959 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-15T03:05:33.959 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-15T03:05:33.959 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-15T03:05:33.960 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-15T03:05:33.980 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-15T03:05:33.980 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-15T03:05:33.980 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-15T03:05:33.981 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-15T03:05:33.984 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-15T03:05:33.985 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-15T03:05:33.990 INFO:teuthology.orchestra.run.smithi104.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,231 kB] 2024-09-15T03:05:34.000 INFO:teuthology.orchestra.run.smithi104.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-15T03:05:34.002 INFO:teuthology.orchestra.run.smithi104.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-15T03:05:34.003 INFO:teuthology.orchestra.run.smithi104.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-15T03:05:34.003 INFO:teuthology.orchestra.run.smithi104.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-15T03:05:34.003 INFO:teuthology.orchestra.run.smithi104.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-15T03:05:34.004 INFO:teuthology.orchestra.run.smithi104.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-15T03:05:34.004 INFO:teuthology.orchestra.run.smithi104.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-15T03:05:34.005 INFO:teuthology.orchestra.run.smithi104.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-15T03:05:34.021 INFO:teuthology.orchestra.run.smithi104.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-15T03:05:34.021 INFO:teuthology.orchestra.run.smithi104.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-15T03:05:34.022 INFO:teuthology.orchestra.run.smithi104.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-15T03:05:34.022 INFO:teuthology.orchestra.run.smithi104.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-15T03:05:34.062 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-15T03:05:34.123 INFO:teuthology.orchestra.run.smithi104.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-15T03:05:34.397 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-15T03:05:34.459 INFO:teuthology.orchestra.run.smithi104.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-15T03:05:34.589 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-15T03:05:34.603 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-15T03:05:34.603 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-15T03:05:34.652 INFO:teuthology.orchestra.run.smithi104.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-15T03:05:34.667 INFO:teuthology.orchestra.run.smithi104.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-15T03:05:34.667 INFO:teuthology.orchestra.run.smithi104.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-15T03:05:34.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-15T03:05:34.695 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-15T03:05:34.709 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-15T03:05:34.709 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-15T03:05:34.736 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-15T03:05:34.758 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-15T03:05:34.761 INFO:teuthology.orchestra.run.smithi104.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-15T03:05:34.762 INFO:teuthology.orchestra.run.smithi104.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-15T03:05:34.767 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-15T03:05:34.767 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-15T03:05:34.767 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-15T03:05:34.774 INFO:teuthology.orchestra.run.smithi104.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-15T03:05:34.774 INFO:teuthology.orchestra.run.smithi104.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-15T03:05:34.802 INFO:teuthology.orchestra.run.smithi104.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-15T03:05:34.821 INFO:teuthology.orchestra.run.smithi104.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-15T03:05:34.827 INFO:teuthology.orchestra.run.smithi104.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-15T03:05:34.828 INFO:teuthology.orchestra.run.smithi104.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-15T03:05:34.833 INFO:teuthology.orchestra.run.smithi104.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-15T03:05:34.838 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-15T03:05:34.839 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-15T03:05:34.899 INFO:teuthology.orchestra.run.smithi104.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-15T03:05:34.900 INFO:teuthology.orchestra.run.smithi104.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-15T03:05:38.337 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 21.8 MB in 3s (7,036 kB/s) 2024-09-15T03:05:38.428 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 21.8 MB in 3s (6,953 kB/s) 2024-09-15T03:05:39.942 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-09-15T03:05:39.969 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-09-15T03:05:40.038 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-09-15T03:05:40.115 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-15T03:05:40.144 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-09-15T03:05:40.234 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-15T03:05:40.256 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-09-15T03:05:40.257 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-09-15T03:05:40.448 INFO:teuthology.orchestra.run.smithi104.stdout:The following additional packages will be installed: 2024-09-15T03:05:40.448 INFO:teuthology.orchestra.run.smithi104.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-09-15T03:05:40.448 INFO:teuthology.orchestra.run.smithi104.stdout: libusbmuxd6 linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T03:05:40.449 INFO:teuthology.orchestra.run.smithi104.stdout: linux-modules-extra-5.15.0-121-generic thermald upower usbmuxd 2024-09-15T03:05:40.450 INFO:teuthology.orchestra.run.smithi104.stdout:Suggested packages: 2024-09-15T03:05:40.450 INFO:teuthology.orchestra.run.smithi104.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2024-09-15T03:05:40.450 INFO:teuthology.orchestra.run.smithi104.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-121-generic 2024-09-15T03:05:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-09-15T03:05:40.460 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-09-15T03:05:40.496 INFO:teuthology.orchestra.run.smithi104.stdout:The following NEW packages will be installed: 2024-09-15T03:05:40.496 INFO:teuthology.orchestra.run.smithi104.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-09-15T03:05:40.497 INFO:teuthology.orchestra.run.smithi104.stdout: libusbmuxd6 linux-image-5.15.0-121-generic linux-image-generic-hwe-20.04 2024-09-15T03:05:40.497 INFO:teuthology.orchestra.run.smithi104.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T03:05:40.497 INFO:teuthology.orchestra.run.smithi104.stdout: thermald upower usbmuxd 2024-09-15T03:05:40.666 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-09-15T03:05:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-09-15T03:05:40.666 INFO:teuthology.orchestra.run.smithi053.stdout: libusbmuxd6 linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-15T03:05:40.667 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-extra-5.15.0-121-generic thermald upower usbmuxd 2024-09-15T03:05:40.668 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-09-15T03:05:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2024-09-15T03:05:40.668 INFO:teuthology.orchestra.run.smithi053.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-121-generic 2024-09-15T03:05:40.680 INFO:teuthology.orchestra.run.smithi104.stdout:0 upgraded, 13 newly installed, 0 to remove and 319 not upgraded. 2024-09-15T03:05:40.681 INFO:teuthology.orchestra.run.smithi104.stdout:Need to get 95.1 MB of archives. 2024-09-15T03:05:40.681 INFO:teuthology.orchestra.run.smithi104.stdout:After this operation, 594 MB of additional disk space will be used. 2024-09-15T03:05:40.681 INFO:teuthology.orchestra.run.smithi104.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2024-09-15T03:05:40.721 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-09-15T03:05:40.721 INFO:teuthology.orchestra.run.smithi053.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2024-09-15T03:05:40.721 INFO:teuthology.orchestra.run.smithi053.stdout: libusbmuxd6 linux-image-5.15.0-121-generic linux-image-generic-hwe-20.04 2024-09-15T03:05:40.722 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-15T03:05:40.722 INFO:teuthology.orchestra.run.smithi053.stdout: thermald upower usbmuxd 2024-09-15T03:05:40.779 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 13 newly installed, 0 to remove and 319 not upgraded. 2024-09-15T03:05:40.779 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 95.1 MB of archives. 2024-09-15T03:05:40.779 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 594 MB of additional disk space will be used. 2024-09-15T03:05:40.779 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2024-09-15T03:05:40.837 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2024-09-15T03:05:40.843 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2024-09-15T03:05:40.847 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2024-09-15T03:05:40.862 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2024-09-15T03:05:40.870 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131~20.04.1 [22.3 MB] 2024-09-15T03:05:40.955 INFO:teuthology.orchestra.run.smithi104.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2024-09-15T03:05:40.986 INFO:teuthology.orchestra.run.smithi104.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2024-09-15T03:05:41.005 INFO:teuthology.orchestra.run.smithi104.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2024-09-15T03:05:41.080 INFO:teuthology.orchestra.run.smithi104.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2024-09-15T03:05:41.114 INFO:teuthology.orchestra.run.smithi104.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131~20.04.1 [22.3 MB] 2024-09-15T03:05:41.178 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131~20.04.1 [11.4 MB] 2024-09-15T03:05:41.279 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131~20.04.1 [60.7 MB] 2024-09-15T03:05:42.041 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.121.131~20.04.1 [2,572 B] 2024-09-15T03:05:42.041 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2024-09-15T03:05:42.042 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.7 [234 kB] 2024-09-15T03:05:42.048 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2024-09-15T03:05:42.050 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2024-09-15T03:05:42.069 INFO:teuthology.orchestra.run.smithi104.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131~20.04.1 [11.4 MB] 2024-09-15T03:05:42.366 INFO:teuthology.orchestra.run.smithi104.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131~20.04.1 [60.7 MB] 2024-09-15T03:05:42.741 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 95.1 MB in 1s (72.1 MB/s) 2024-09-15T03:05:42.955 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2024-09-15T03:05:44.376 INFO:teuthology.orchestra.run.smithi104.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.121.131~20.04.1 [2,572 B] 2024-09-15T03:05:44.376 INFO:teuthology.orchestra.run.smithi104.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2024-09-15T03:05:44.377 INFO:teuthology.orchestra.run.smithi104.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.7 [234 kB] 2024-09-15T03:05:44.382 INFO:teuthology.orchestra.run.smithi104.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2024-09-15T03:05:44.383 INFO:teuthology.orchestra.run.smithi104.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2024-09-15T03:05:44.646 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-15T03:05:44.651 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2024-09-15T03:05:44.878 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-09-15T03:05:45.122 INFO:teuthology.orchestra.run.smithi104.stdout:Fetched 95.1 MB in 4s (24.5 MB/s) 2024-09-15T03:05:45.289 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libplist3:amd64. 2024-09-15T03:05:45.303 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2024-09-15T03:05:45.347 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2024-09-15T03:05:45.356 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2024-09-15T03:05:45.769 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2024-09-15T03:05:45.781 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2024-09-15T03:05:45.817 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2024-09-15T03:05:46.195 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2024-09-15T03:05:46.212 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2024-09-15T03:05:46.254 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-09-15T03:05:46.623 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libupower-glib3:amd64. 2024-09-15T03:05:46.640 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2024-09-15T03:05:46.682 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2024-09-15T03:05:47.027 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T03:05:47.042 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../05-linux-modules-5.15.0-121-generic_5.15.0-121.131~20.04.1_amd64.deb ... 2024-09-15T03:05:47.085 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:05:47.144 INFO:teuthology.orchestra.run.smithi104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-15T03:05:47.149 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2024-09-15T03:05:47.353 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-09-15T03:05:47.722 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libplist3:amd64. 2024-09-15T03:05:47.735 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2024-09-15T03:05:47.780 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2024-09-15T03:05:48.133 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2024-09-15T03:05:48.148 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2024-09-15T03:05:48.225 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2024-09-15T03:05:48.586 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2024-09-15T03:05:48.603 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2024-09-15T03:05:48.645 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-09-15T03:05:49.014 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libupower-glib3:amd64. 2024-09-15T03:05:49.028 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2024-09-15T03:05:49.089 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2024-09-15T03:05:49.409 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-15T03:05:49.425 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../05-linux-modules-5.15.0-121-generic_5.15.0-121.131~20.04.1_amd64.deb ... 2024-09-15T03:05:49.467 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:05:50.129 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T03:05:50.143 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../06-linux-image-5.15.0-121-generic_5.15.0-121.131~20.04.1_amd64.deb ... 2024-09-15T03:05:50.236 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:05:50.773 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T03:05:50.787 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131~20.04.1_amd64.deb ... 2024-09-15T03:05:50.831 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:05:52.476 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-15T03:05:52.491 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../06-linux-image-5.15.0-121-generic_5.15.0-121.131~20.04.1_amd64.deb ... 2024-09-15T03:05:52.593 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:05:53.154 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-15T03:05:53.167 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131~20.04.1_amd64.deb ... 2024-09-15T03:05:53.204 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:05:58.528 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2024-09-15T03:05:58.547 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.121.131~20.04.1_amd64.deb ... 2024-09-15T03:05:58.586 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.121.131~20.04.1) ... 2024-09-15T03:05:58.971 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libevdev2:amd64. 2024-09-15T03:05:58.985 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2024-09-15T03:05:59.021 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-09-15T03:05:59.425 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package thermald. 2024-09-15T03:05:59.441 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.7_amd64.deb ... 2024-09-15T03:05:59.483 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking thermald (1.9.1-1ubuntu0.7) ... 2024-09-15T03:06:00.105 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package upower. 2024-09-15T03:06:00.120 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2024-09-15T03:06:00.196 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking upower (0.99.11-1build2) ... 2024-09-15T03:06:00.651 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package usbmuxd. 2024-09-15T03:06:00.666 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2024-09-15T03:06:00.709 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-09-15T03:06:00.979 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2024-09-15T03:06:00.994 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.121.131~20.04.1_amd64.deb ... 2024-09-15T03:06:01.025 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2024-09-15T03:06:01.037 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.121.131~20.04.1) ... 2024-09-15T03:06:01.156 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-09-15T03:06:01.257 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2024-09-15T03:06:01.381 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package libevdev2:amd64. 2024-09-15T03:06:01.383 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2024-09-15T03:06:01.396 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2024-09-15T03:06:01.439 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-09-15T03:06:01.534 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-09-15T03:06:01.660 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-09-15T03:06:01.820 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up upower (0.99.11-1build2) ... 2024-09-15T03:06:01.875 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package thermald. 2024-09-15T03:06:01.889 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.7_amd64.deb ... 2024-09-15T03:06:01.933 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking thermald (1.9.1-1ubuntu0.7) ... 2024-09-15T03:06:02.360 INFO:teuthology.orchestra.run.smithi053.stdout:upower.service is a disabled or a static unit, not starting it. 2024-09-15T03:06:02.432 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-09-15T03:06:02.505 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package upower. 2024-09-15T03:06:02.518 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2024-09-15T03:06:02.575 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking upower (0.99.11-1build2) ... 2024-09-15T03:06:02.655 INFO:teuthology.orchestra.run.smithi053.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2024-09-15T03:06:02.666 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user `usbmux' (UID 114) ... 2024-09-15T03:06:02.666 INFO:teuthology.orchestra.run.smithi053.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2024-09-15T03:06:03.034 INFO:teuthology.orchestra.run.smithi104.stdout:Selecting previously unselected package usbmuxd. 2024-09-15T03:06:03.049 INFO:teuthology.orchestra.run.smithi104.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2024-09-15T03:06:03.092 INFO:teuthology.orchestra.run.smithi104.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-09-15T03:06:03.216 INFO:teuthology.orchestra.run.smithi053.stdout:Not creating home directory `/var/lib/usbmux'. 2024-09-15T03:06:03.406 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2024-09-15T03:06:03.418 INFO:teuthology.orchestra.run.smithi053.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2024-09-15T03:06:03.488 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up thermald (1.9.1-1ubuntu0.7) ... 2024-09-15T03:06:03.564 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2024-09-15T03:06:03.690 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2024-09-15T03:06:03.815 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2024-09-15T03:06:03.844 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2024-09-15T03:06:03.844 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2024-09-15T03:06:03.958 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2024-09-15T03:06:04.085 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2024-09-15T03:06:04.235 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up upower (0.99.11-1build2) ... 2024-09-15T03:06:04.301 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:04.773 INFO:teuthology.orchestra.run.smithi104.stdout:upower.service is a disabled or a static unit, not starting it. 2024-09-15T03:06:04.831 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2024-09-15T03:06:05.030 INFO:teuthology.orchestra.run.smithi104.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2024-09-15T03:06:05.039 INFO:teuthology.orchestra.run.smithi104.stdout:Adding system user `usbmux' (UID 114) ... 2024-09-15T03:06:05.039 INFO:teuthology.orchestra.run.smithi104.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2024-09-15T03:06:05.682 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T03:06:05.683 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:05.875 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:06.799 INFO:teuthology.orchestra.run.smithi104.stdout:Not creating home directory `/var/lib/usbmux'. 2024-09-15T03:06:07.032 INFO:teuthology.orchestra.run.smithi104.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2024-09-15T03:06:07.070 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up thermald (1.9.1-1ubuntu0.7) ... 2024-09-15T03:06:07.403 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2024-09-15T03:06:07.403 INFO:teuthology.orchestra.run.smithi104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2024-09-15T03:06:07.899 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:08.091 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:09.227 INFO:teuthology.orchestra.run.smithi104.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-15T03:06:09.227 INFO:teuthology.orchestra.run.smithi104.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:09.367 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:09.942 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.121.131~20.04.1) ... 2024-09-15T03:06:10.075 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-15T03:06:10.348 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-15T03:06:10.761 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:11.176 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-15T03:06:11.259 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:11.318 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T03:06:11.318 INFO:teuthology.orchestra.run.smithi053.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:12.562 INFO:teuthology.orchestra.run.smithi104.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.121.131~20.04.1) ... 2024-09-15T03:06:12.688 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-15T03:06:13.002 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-15T03:06:13.771 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-15T03:06:13.872 INFO:teuthology.orchestra.run.smithi104.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131~20.04.1) ... 2024-09-15T03:06:13.956 INFO:teuthology.orchestra.run.smithi104.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-15T03:06:13.956 INFO:teuthology.orchestra.run.smithi104.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:40.024 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T03:06:40.025 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub' 2024-09-15T03:06:40.036 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T03:06:40.062 INFO:teuthology.orchestra.run.smithi053.stdout:Generating grub configuration file ... 2024-09-15T03:06:40.418 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T03:06:40.456 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:40.906 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-15T03:06:40.917 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-15T03:06:41.085 INFO:teuthology.orchestra.run.smithi104.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-15T03:06:41.085 INFO:teuthology.orchestra.run.smithi104.stdout:Sourcing file `/etc/default/grub' 2024-09-15T03:06:41.091 INFO:teuthology.orchestra.run.smithi104.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T03:06:41.118 INFO:teuthology.orchestra.run.smithi104.stdout:Generating grub configuration file ... 2024-09-15T03:06:41.502 INFO:teuthology.orchestra.run.smithi104.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T03:06:41.524 INFO:teuthology.orchestra.run.smithi104.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:41.968 INFO:teuthology.orchestra.run.smithi104.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-15T03:06:41.979 INFO:teuthology.orchestra.run.smithi104.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-15T03:06:43.210 INFO:teuthology.orchestra.run.smithi053.stdout:done 2024-09-15T03:06:43.688 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic-hwe-20.04 2024-09-15T03:06:43.737 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic-hwe-20.04 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta-hwe-5.15 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.121.131~20.04.1 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T03:06:43.738 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-09-15T03:06:43.739 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-09-15T03:06:43.739 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-09-15T03:06:43.739 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-09-15T03:06:43.739 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-121-generic 2024-09-15T03:06:43.739 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T03:06:43.739 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T03:06:43.739 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T03:06:43.739 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T03:06:43.740 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-09-15T03:06:43.837 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-09-15T03:06:44.100 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-15T03:06:44.100 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-15T03:06:44.156 INFO:teuthology.orchestra.run.smithi104.stdout:done 2024-09-15T03:06:44.170 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-15T03:06:44.252 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-15T03:06:44.655 DEBUG:teuthology.orchestra.run.smithi104:> dpkg -s linux-image-generic-hwe-20.04 2024-09-15T03:06:44.699 INFO:teuthology.orchestra.run.smithi104.stdout:Package: linux-image-generic-hwe-20.04 2024-09-15T03:06:44.699 INFO:teuthology.orchestra.run.smithi104.stdout:Status: install ok installed 2024-09-15T03:06:44.699 INFO:teuthology.orchestra.run.smithi104.stdout:Priority: optional 2024-09-15T03:06:44.699 INFO:teuthology.orchestra.run.smithi104.stdout:Section: kernel 2024-09-15T03:06:44.699 INFO:teuthology.orchestra.run.smithi104.stdout:Installed-Size: 21 2024-09-15T03:06:44.699 INFO:teuthology.orchestra.run.smithi104.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T03:06:44.699 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: amd64 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout:Source: linux-meta-hwe-5.15 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout:Version: 5.15.0.121.131~20.04.1 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout:Recommends: thermald 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout:Description: Generic Linux kernel image 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout: This package will always depend on the latest generic kernel image 2024-09-15T03:06:44.700 INFO:teuthology.orchestra.run.smithi104.stdout: available. 2024-09-15T03:06:44.700 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-121-generic 2024-09-15T03:06:44.700 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T03:06:44.700 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T03:06:44.701 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-15T03:06:44.701 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi104.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T03:06:44.701 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get clean 2024-09-15T03:06:44.795 DEBUG:teuthology.orchestra.run.smithi104:> sudo apt-get update 2024-09-15T03:06:44.928 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-15T03:06:45.045 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-15T03:06:45.127 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-15T03:06:45.208 INFO:teuthology.orchestra.run.smithi104.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-15T03:06:46.019 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-15T03:06:46.045 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-09-15T03:06:46.117 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-09-15T03:06:46.341 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-09-15T03:06:46.342 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-09-15T03:06:46.590 INFO:teuthology.orchestra.run.smithi053.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.121.131~20.04.1). 2024-09-15T03:06:46.590 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 0 newly installed, 0 to remove and 319 not upgraded. 2024-09-15T03:06:46.592 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic-hwe-20.04 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic-hwe-20.04 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta-hwe-5.15 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.121.131~20.04.1 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T03:06:46.610 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T03:06:46.611 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-09-15T03:06:46.611 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-09-15T03:06:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-09-15T03:06:46.611 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-09-15T03:06:46.611 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-09-15T03:06:46.615 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.ybuFKa8aaO 2024-09-15T03:06:46.615 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ybuFKa8aaO 2024-09-15T03:06:46.674 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.ybuFKa8aaO 2024-09-15T03:06:46.709 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.ybuFKa8aaO is 9KB 2024-09-15T03:06:46.723 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.ybuFKa8aaO 2024-09-15T03:06:46.730 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T03:06:46.785 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:06:46.785 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T03:06:46.786 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T03:06:46.804 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-09-15T03:06:46.814 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T03:06:46.814 DEBUG:teuthology.orchestra.run.smithi053:> sudo update-grub 2024-09-15T03:06:46.831 DEBUG:teuthology.orchestra.run.smithi104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2024-09-15T03:06:46.901 INFO:teuthology.orchestra.run.smithi104.stdout:Reading package lists... 2024-09-15T03:06:47.119 INFO:teuthology.orchestra.run.smithi104.stdout:Building dependency tree... 2024-09-15T03:06:47.119 INFO:teuthology.orchestra.run.smithi104.stdout:Reading state information... 2024-09-15T03:06:47.347 INFO:teuthology.orchestra.run.smithi104.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.121.131~20.04.1). 2024-09-15T03:06:47.347 INFO:teuthology.orchestra.run.smithi104.stdout:0 upgraded, 0 newly installed, 0 to remove and 319 not upgraded. 2024-09-15T03:06:47.349 DEBUG:teuthology.orchestra.run.smithi104:> dpkg -s linux-image-generic-hwe-20.04 2024-09-15T03:06:47.369 INFO:teuthology.orchestra.run.smithi104.stdout:Package: linux-image-generic-hwe-20.04 2024-09-15T03:06:47.369 INFO:teuthology.orchestra.run.smithi104.stdout:Status: install ok installed 2024-09-15T03:06:47.369 INFO:teuthology.orchestra.run.smithi104.stdout:Priority: optional 2024-09-15T03:06:47.369 INFO:teuthology.orchestra.run.smithi104.stdout:Section: kernel 2024-09-15T03:06:47.369 INFO:teuthology.orchestra.run.smithi104.stdout:Installed-Size: 21 2024-09-15T03:06:47.369 INFO:teuthology.orchestra.run.smithi104.stdout:Maintainer: Ubuntu Kernel Team 2024-09-15T03:06:47.369 INFO:teuthology.orchestra.run.smithi104.stdout:Architecture: amd64 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout:Source: linux-meta-hwe-5.15 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout:Version: 5.15.0.121.131~20.04.1 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout:Recommends: thermald 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout:Description: Generic Linux kernel image 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout: This package will always depend on the latest generic kernel image 2024-09-15T03:06:47.370 INFO:teuthology.orchestra.run.smithi104.stdout: available. 2024-09-15T03:06:47.370 DEBUG:teuthology.orchestra.run.smithi104:> mktemp 2024-09-15T03:06:47.376 INFO:teuthology.orchestra.run.smithi104.stdout:/tmp/tmp.w19lVNX8rL 2024-09-15T03:06:47.377 DEBUG:teuthology.orchestra.run.smithi104:> sudo cp /boot/grub/grub.cfg /tmp/tmp.w19lVNX8rL 2024-09-15T03:06:47.390 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0666 /tmp/tmp.w19lVNX8rL 2024-09-15T03:06:47.430 DEBUG:teuthology.orchestra.remote:smithi104:/tmp/tmp.w19lVNX8rL is 9KB 2024-09-15T03:06:47.444 DEBUG:teuthology.orchestra.run.smithi104:> rm -fr /tmp/tmp.w19lVNX8rL 2024-09-15T03:06:47.451 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-15T03:06:47.507 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:06:47.508 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-15T03:06:47.508 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-15T03:06:47.532 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-15T03:06:47.532 DEBUG:teuthology.orchestra.run.smithi104:> sudo update-grub 2024-09-15T03:06:48.269 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub' 2024-09-15T03:06:48.278 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T03:06:48.284 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-09-15T03:06:48.564 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T03:06:48.576 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:48.980 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-15T03:06:48.991 INFO:teuthology.orchestra.run.smithi104.stderr:Sourcing file `/etc/default/grub' 2024-09-15T03:06:48.991 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-15T03:06:48.998 INFO:teuthology.orchestra.run.smithi104.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T03:06:49.008 INFO:teuthology.orchestra.run.smithi104.stderr:Generating grub configuration file ... 2024-09-15T03:06:49.301 INFO:teuthology.orchestra.run.smithi104.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-15T03:06:49.313 INFO:teuthology.orchestra.run.smithi104.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-15T03:06:49.692 INFO:teuthology.orchestra.run.smithi104.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-15T03:06:49.703 INFO:teuthology.orchestra.run.smithi104.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-15T03:06:50.169 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-09-15T03:06:50.170 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-09-15T03:06:50.719 INFO:teuthology.orchestra.run.smithi104.stderr:done 2024-09-15T03:06:50.720 DEBUG:teuthology.orchestra.run.smithi104:> sudo shutdown -r now 2024-09-15T03:07:20.203 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T03:07:20.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-15T03:07:20.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:07:20.723 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-15T03:07:20.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-15T03:07:20.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:07:38.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-09-15T03:07:39.197 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-15T03:07:47.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-15T03:07:47.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:07:48.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-15T03:07:48.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:07:51.265 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-15T03:08:03.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-15T03:08:03.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:08:21.700 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-09-15T03:08:36.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-15T03:08:36.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:08:36.950 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-15T03:08:37.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-15T03:08:37.872 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-15T03:08:37.873 DEBUG:teuthology.orchestra.run.smithi104:> uname -r 2024-09-15T03:08:37.879 INFO:teuthology.orchestra.run.smithi104.stdout:5.15.0-121-generic 2024-09-15T03:08:37.880 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T03:08:37.880 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T03:08:37.880 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T03:08:38.880 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-15T03:08:38.881 DEBUG:teuthology.orchestra.run.smithi104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T03:08:38.980 INFO:teuthology.orchestra.run.smithi104.stdout:ttyS1 2024-09-15T03:08:39.008 DEBUG:teuthology.parallel:result is None 2024-09-15T03:08:47.699 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T03:08:59.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-15T03:08:59.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:08:59.939 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-15T03:09:00.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-15T03:09:00.496 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-15T03:09:00.497 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-09-15T03:09:00.546 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-121-generic 2024-09-15T03:09:00.546 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-15T03:09:00.546 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T03:09:00.546 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T03:09:01.547 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T03:09:01.548 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T03:09:01.630 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-09-15T03:09:01.658 DEBUG:teuthology.parallel:result is None 2024-09-15T03:09:01.658 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T03:09:01.671 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T03:09:01.672 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T03:09:01.674 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T03:09:01.682 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T03:09:01.711 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T03:09:01.745 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T03:09:01.746 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T03:09:01.749 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T03:09:01.791 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T03:09:01.798 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T03:09:01.798 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T03:09:01.805 DEBUG:teuthology.orchestra.run.smithi104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T03:09:01.820 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T03:09:01.827 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T03:09:01.865 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T03:09:01.876 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T03:09:01.878 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T03:09:01.886 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T03:09:01.886 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T03:09:01.888 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T03:09:01.939 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T03:09:01.949 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T03:09:01.949 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T03:09:01.951 DEBUG:teuthology.orchestra.run.smithi104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T03:09:01.989 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T03:09:02.006 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T03:09:02.054 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:09:02.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T03:09:02.114 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T03:09:02.121 DEBUG:teuthology.orchestra.run.smithi104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T03:09:02.169 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:09:02.169 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T03:09:02.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-09-15T03:09:02.231 DEBUG:teuthology.orchestra.run.smithi104:> sudo service rsyslog restart 2024-09-15T03:09:02.311 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T03:09:02.319 INFO:teuthology.task.internal:Starting timer... 2024-09-15T03:09:02.319 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T03:09:02.363 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T03:09:02.394 DEBUG:teuthology.task.selinux:Excluding smithi053: OS 'ubuntu' does not support SELinux 2024-09-15T03:09:02.395 DEBUG:teuthology.task.selinux:Excluding smithi104: OS 'ubuntu' does not support SELinux 2024-09-15T03:09:02.395 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T03:09:02.395 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-15T03:09:02.395 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T03:09:02.395 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T03:09:02.426 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T03:09:02.429 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T03:09:02.542 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T03:09:02.553 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T03:09:02.554 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi104.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T03:14:44.812 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi104.front.sepia.ceph.com')] 2024-09-15T03:14:44.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-15T03:14:44.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:14:44.910 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-09-15T03:14:45.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-09-15T03:14:45.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-15T03:14:45.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T03:14:45.121 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-09-15T03:14:45.246 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-09-15T03:14:45.247 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T03:14:45.268 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T03:14:45.269 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T03:14:45.269 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T03:14:45.272 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T03:14:45.272 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T03:14:45.301 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-15T03:14:45.301 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Command line: ntpd -gq 2024-09-15T03:14:45.301 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: proto: precision = 0.082 usec (-23) 2024-09-15T03:14:45.302 INFO:teuthology.orchestra.run.smithi053.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T03:14:45.302 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T03:14:45.303 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T03:14:45.303 INFO:teuthology.orchestra.run.smithi053.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T03:14:45.304 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T03:14:45.304 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T03:14:45.304 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T03:14:45.304 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Listen normally on 3 ens1f0 172.21.15.53:123 2024-09-15T03:14:45.304 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Listen normally on 4 lo [::1]:123 2024-09-15T03:14:45.304 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:3718%4]:123 2024-09-15T03:14:45.304 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:45 ntpd[13505]: Listening on routing socket on fd #22 for interface updates 2024-09-15T03:14:45.323 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-15T03:14:45.323 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Command line: ntpd -gq 2024-09-15T03:14:45.324 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: proto: precision = 0.059 usec (-24) 2024-09-15T03:14:45.324 INFO:teuthology.orchestra.run.smithi104.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T03:14:45.324 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T03:14:45.324 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T03:14:45.325 INFO:teuthology.orchestra.run.smithi104.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T03:14:45.326 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T03:14:45.326 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T03:14:45.326 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T03:14:45.326 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Listen normally on 3 enp3s0f1 172.21.15.104:123 2024-09-15T03:14:45.326 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Listen normally on 4 lo [::1]:123 2024-09-15T03:14:45.326 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce89%5]:123 2024-09-15T03:14:45.326 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:45 ntpd[13543]: Listening on routing socket on fd #22 for interface updates 2024-09-15T03:14:46.301 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:46 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:46.301 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:46 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:46.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:46 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:46.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:46 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:46.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:46 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:46.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:46 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.304 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.305 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.306 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:47.307 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:47 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:47.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.327 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.327 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.327 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.327 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.327 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:47.328 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:47.328 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:47.328 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:47.328 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:47.328 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:47 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:48.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:48 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:48.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:48 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:48.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:48 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:48.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:48 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:48.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:48 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:48.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:48 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:49.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:49 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:49.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:49.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:49 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:50 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:50 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:50 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:50 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:50 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:50.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:50 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:50.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:50 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:50.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:50 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:50.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:50 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:50.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:50 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:50.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:50 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:50.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:50 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:51.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:51 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:51.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:51.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:51 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:52.302 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:52.302 INFO:teuthology.orchestra.run.smithi053.stdout:15 Sep 03:14:52 ntpd[13505]: ntpd: time slew +0.000371 s 2024-09-15T03:14:52.303 INFO:teuthology.orchestra.run.smithi053.stdout:ntpd: time slew +0.000371s 2024-09-15T03:14:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T03:14:52.303 INFO:teuthology.orchestra.run.smithi053.stderr:15 Sep 03:14:52 ntpd[13505]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T03:14:52.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:52 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:52.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:52 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:52.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:52 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:52.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:52 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:52.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:52 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:52.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:52 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:52.357 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T03:14:52.357 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-09-15T03:14:52.357 INFO:teuthology.orchestra.run.smithi053.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:52.358 INFO:teuthology.orchestra.run.smithi053.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:52.358 INFO:teuthology.orchestra.run.smithi053.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:52.358 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:53.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:53.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:53.324 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:53.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:53.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T03:14:53.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T03:14:53.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T03:14:53.325 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T03:14:53.325 INFO:teuthology.orchestra.run.smithi104.stdout:15 Sep 03:14:53 ntpd[13543]: ntpd: time slew +0.002419 s 2024-09-15T03:14:53.325 INFO:teuthology.orchestra.run.smithi104.stdout:ntpd: time slew +0.002419s 2024-09-15T03:14:53.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T03:14:53.326 INFO:teuthology.orchestra.run.smithi104.stderr:15 Sep 03:14:53 ntpd[13543]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T03:14:53.395 INFO:teuthology.orchestra.run.smithi104.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T03:14:53.395 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================== 2024-09-15T03:14:53.395 INFO:teuthology.orchestra.run.smithi104.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:53.395 INFO:teuthology.orchestra.run.smithi104.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:53.395 INFO:teuthology.orchestra.run.smithi104.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:53.395 INFO:teuthology.orchestra.run.smithi104.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-15T03:14:53.396 INFO:teuthology.run_tasks:Running task nvme_loop... 2024-09-15T03:14:53.409 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices... 2024-09-15T03:14:53.409 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:14:53.409 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T03:14:53.417 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T03:14:53.417 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 494 Links: 1 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:13:19.465283193 +0000 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:13:19.213289005 +0000 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:13:19.213289005 +0000 2024-09-15T03:14:53.468 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:14:53.468 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T03:14:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:14:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:14:53.523 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000324436 s, 1.6 MB/s 2024-09-15T03:14:53.524 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T03:14:53.577 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-09-15T03:14:53.627 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T03:14:53.628 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:53.628 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 500 Links: 1 2024-09-15T03:14:53.628 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:53.628 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:13:19.941272216 +0000 2024-09-15T03:14:53.628 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:13:19.681278213 +0000 2024-09-15T03:14:53.628 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:13:19.681278213 +0000 2024-09-15T03:14:53.628 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:14:53.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T03:14:53.681 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:14:53.681 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:14:53.681 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000356948 s, 1.4 MB/s 2024-09-15T03:14:53.683 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T03:14:53.737 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-09-15T03:14:53.787 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T03:14:53.787 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:53.787 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 507 Links: 1 2024-09-15T03:14:53.787 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:53.787 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:13:20.437260777 +0000 2024-09-15T03:14:53.787 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:13:20.149267419 +0000 2024-09-15T03:14:53.788 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:13:20.149267419 +0000 2024-09-15T03:14:53.788 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:14:53.788 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T03:14:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:14:53.842 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:14:53.843 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000284099 s, 1.8 MB/s 2024-09-15T03:14:53.844 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T03:14:53.897 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-09-15T03:14:53.947 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T03:14:53.947 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:53.947 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 513 Links: 1 2024-09-15T03:14:53.948 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:53.948 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:13:20.997247863 +0000 2024-09-15T03:14:53.948 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:13:20.765253212 +0000 2024-09-15T03:14:53.948 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:13:20.765253212 +0000 2024-09-15T03:14:53.948 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:14:53.948 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T03:14:54.002 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:14:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:14:54.003 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000305653 s, 1.7 MB/s 2024-09-15T03:14:54.004 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T03:14:54.057 DEBUG:teuthology.orchestra.run.smithi053:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2024-09-15T03:14:54.176 INFO:teuthology.orchestra.run.smithi053.stdout:loop 2024-09-15T03:14:54.177 INFO:tasks.nvme_loop:Connecting nvme_loop smithi053:/dev/vg_nvme/lv_1... 2024-09-15T03:14:54.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2024-09-15T03:14:54.199 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.217 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/vg_nvme/lv_1 2024-09-15T03:14:54.224 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.244 INFO:tasks.nvme_loop:Connecting nvme_loop smithi053:/dev/vg_nvme/lv_2... 2024-09-15T03:14:54.244 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2024-09-15T03:14:54.310 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.326 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/vg_nvme/lv_2 2024-09-15T03:14:54.332 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.354 INFO:tasks.nvme_loop:Connecting nvme_loop smithi053:/dev/vg_nvme/lv_3... 2024-09-15T03:14:54.354 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2024-09-15T03:14:54.418 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.435 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/vg_nvme/lv_3 2024-09-15T03:14:54.446 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.471 INFO:tasks.nvme_loop:Connecting nvme_loop smithi053:/dev/vg_nvme/lv_4... 2024-09-15T03:14:54.471 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2024-09-15T03:14:54.538 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.556 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/vg_nvme/lv_4 2024-09-15T03:14:54.566 INFO:teuthology.orchestra.run.smithi053.stdout:1 2024-09-15T03:14:54.592 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:14:54.592 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T03:14:54.643 DEBUG:teuthology.orchestra.run.smithi053:> sudo nvme list 2024-09-15T03:14:54.703 INFO:teuthology.orchestra.run.smithi053.stdout:Node SN Model Namespace Usage Format FW Rev 2024-09-15T03:14:54.703 INFO:teuthology.orchestra.run.smithi053.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- -------- 2024-09-15T03:14:54.703 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/nvme0n1 PHMB751300G8480DGN INTEL SSDPED1D480GA 1 480.10 GB / 480.10 GB 512 B + 0 B E2010325 2024-09-15T03:14:54.703 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/nvme1n1 06acf8e08d56151df8fe Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:54.703 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/nvme2n1 d2eaff4cb325d0aa3804 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:54.703 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/nvme3n1 6097b62f26c6088faba0 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:54.704 INFO:teuthology.orchestra.run.smithi053.stdout:/dev/nvme4n1 bd1f82b910b6c9653a6d Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:54.704 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-09-15T03:14:54.705 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:14:54.705 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/scratch_devs 2024-09-15T03:14:54.762 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:14:54.762 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T03:14:54.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T03:14:54.770 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_1 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 496 Links: 1 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:13:16.335884808 +0000 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:13:16.087890528 +0000 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:13:16.087890528 +0000 2024-09-15T03:14:54.821 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:14:54.821 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T03:14:54.876 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:14:54.876 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:14:54.877 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000427284 s, 1.2 MB/s 2024-09-15T03:14:54.877 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T03:14:54.931 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_2 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 502 Links: 1 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:13:16.771874754 +0000 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:13:16.531880288 +0000 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:13:16.531880288 +0000 2024-09-15T03:14:54.981 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:14:54.982 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T03:14:55.038 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:14:55.038 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:14:55.038 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.0003888 s, 1.3 MB/s 2024-09-15T03:14:55.038 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T03:14:55.090 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_3 2024-09-15T03:14:55.140 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T03:14:55.141 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:55.141 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 508 Links: 1 2024-09-15T03:14:55.141 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:55.141 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:13:17.223864329 +0000 2024-09-15T03:14:55.141 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:13:16.963870326 +0000 2024-09-15T03:14:55.141 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:13:16.963870326 +0000 2024-09-15T03:14:55.141 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:14:55.141 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T03:14:55.194 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:14:55.194 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:14:55.194 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.00037275 s, 1.4 MB/s 2024-09-15T03:14:55.195 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T03:14:55.246 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/vg_nvme/lv_4 2024-09-15T03:14:55.296 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T03:14:55.297 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T03:14:55.297 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 514 Links: 1 2024-09-15T03:14:55.297 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T03:14:55.297 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:13:17.707853168 +0000 2024-09-15T03:14:55.297 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:13:17.447859164 +0000 2024-09-15T03:14:55.297 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:13:17.447859164 +0000 2024-09-15T03:14:55.297 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:14:55.297 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T03:14:55.352 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:14:55.352 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:14:55.352 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000372605 s, 1.4 MB/s 2024-09-15T03:14:55.353 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T03:14:55.402 DEBUG:teuthology.orchestra.run.smithi104:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2024-09-15T03:14:55.546 INFO:teuthology.orchestra.run.smithi104.stdout:loop 2024-09-15T03:14:55.548 INFO:tasks.nvme_loop:Connecting nvme_loop smithi104:/dev/vg_nvme/lv_1... 2024-09-15T03:14:55.548 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2024-09-15T03:14:55.566 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.580 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/vg_nvme/lv_1 2024-09-15T03:14:55.587 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.609 INFO:tasks.nvme_loop:Connecting nvme_loop smithi104:/dev/vg_nvme/lv_2... 2024-09-15T03:14:55.609 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2024-09-15T03:14:55.675 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.692 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/vg_nvme/lv_2 2024-09-15T03:14:55.700 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.725 INFO:tasks.nvme_loop:Connecting nvme_loop smithi104:/dev/vg_nvme/lv_3... 2024-09-15T03:14:55.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2024-09-15T03:14:55.790 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.806 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/vg_nvme/lv_3 2024-09-15T03:14:55.816 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.835 INFO:tasks.nvme_loop:Connecting nvme_loop smithi104:/dev/vg_nvme/lv_4... 2024-09-15T03:14:55.835 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2024-09-15T03:14:55.899 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.917 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/vg_nvme/lv_4 2024-09-15T03:14:55.923 INFO:teuthology.orchestra.run.smithi104.stdout:1 2024-09-15T03:14:55.944 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:14:55.944 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T03:14:55.992 DEBUG:teuthology.orchestra.run.smithi104:> sudo nvme list 2024-09-15T03:14:56.046 INFO:teuthology.orchestra.run.smithi104.stdout:Node SN Model Namespace Usage Format FW Rev 2024-09-15T03:14:56.046 INFO:teuthology.orchestra.run.smithi104.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- -------- 2024-09-15T03:14:56.046 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/nvme0n1 PHFT620400NW400BGN INTEL SSDPEDMD400G4 1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0 2024-09-15T03:14:56.046 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/nvme1n1 6ac73f896f29086606ab Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:56.046 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/nvme2n1 0c7a36dbe289990b1bb2 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:56.047 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/nvme3n1 a42c440931d6b58411a5 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:56.047 INFO:teuthology.orchestra.run.smithi104.stdout:/dev/nvme4n1 7ebeddb4a4c99ecb5ef3 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 5.15.0-1 2024-09-15T03:14:56.047 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-09-15T03:14:56.048 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:14:56.048 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/scratch_devs 2024-09-15T03:14:56.103 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T03:14:56.191 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'global': {'mon election default strategy': 3}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'MON_DOWN', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd75f23820806da622f561ee5ee7551015285993f'} 2024-09-15T03:14:56.191 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f 2024-09-15T03:14:56.191 INFO:tasks.cephadm:Cluster fsid is aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:14:56.192 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T03:14:56.192 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.53', 'mon.c': '[v2:172.21.15.53:3301,v1:172.21.15.53:6790]', 'mon.b': '172.21.15.104'} 2024-09-15T03:14:56.192 INFO:tasks.cephadm:First mon is mon.a on smithi053 2024-09-15T03:14:56.192 INFO:tasks.cephadm:First mgr is y 2024-09-15T03:14:56.192 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T03:14:56.193 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname $(hostname -s) 2024-09-15T03:14:56.208 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname $(hostname -s) 2024-09-15T03:14:56.225 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph-ci.git ref d75f23820806da622f561ee5ee7551015285993f)... 2024-09-15T03:14:56.225 DEBUG:teuthology.orchestra.run.smithi053:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/d75f23820806da622f561ee5ee7551015285993f/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T03:14:56.443 INFO:teuthology.orchestra.run.smithi053.stdout:-rw-rw-r-- 1 ubuntu ubuntu 378585 Sep 15 03:14 /home/ubuntu/cephtest/cephadm 2024-09-15T03:14:56.443 DEBUG:teuthology.orchestra.run.smithi104:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/d75f23820806da622f561ee5ee7551015285993f/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T03:14:56.637 INFO:teuthology.orchestra.run.smithi104.stdout:-rw-rw-r-- 1 ubuntu ubuntu 378585 Sep 15 03:14 /home/ubuntu/cephtest/cephadm 2024-09-15T03:14:56.638 DEBUG:teuthology.orchestra.run.smithi053:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T03:14:56.647 DEBUG:teuthology.orchestra.run.smithi104:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T03:14:56.668 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f on all hosts... 2024-09-15T03:14:56.668 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f pull 2024-09-15T03:14:56.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f pull 2024-09-15T03:14:56.922 INFO:teuthology.orchestra.run.smithi053.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f... 2024-09-15T03:14:56.957 INFO:teuthology.orchestra.run.smithi104.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f... 2024-09-15T03:15:45.560 INFO:teuthology.orchestra.run.smithi104.stdout:{ 2024-09-15T03:15:45.560 INFO:teuthology.orchestra.run.smithi104.stdout: "ceph_version": "ceph version 17.2.7-1643-gd75f2382 (d75f23820806da622f561ee5ee7551015285993f) quincy (stable)", 2024-09-15T03:15:45.561 INFO:teuthology.orchestra.run.smithi104.stdout: "image_id": "5c88729ed6d5bf43038296d22a5895511cd0af7c2172156b411462c2685712d0", 2024-09-15T03:15:45.561 INFO:teuthology.orchestra.run.smithi104.stdout: "repo_digests": [ 2024-09-15T03:15:45.561 INFO:teuthology.orchestra.run.smithi104.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b74feaf32e117a824018a514c6386b2ab812fa0078f0a1365fcf1c4c7be8bdac" 2024-09-15T03:15:45.561 INFO:teuthology.orchestra.run.smithi104.stdout: ] 2024-09-15T03:15:45.561 INFO:teuthology.orchestra.run.smithi104.stdout:} 2024-09-15T03:15:48.277 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-09-15T03:15:48.277 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 17.2.7-1643-gd75f2382 (d75f23820806da622f561ee5ee7551015285993f) quincy (stable)", 2024-09-15T03:15:48.277 INFO:teuthology.orchestra.run.smithi053.stdout: "image_id": "5c88729ed6d5bf43038296d22a5895511cd0af7c2172156b411462c2685712d0", 2024-09-15T03:15:48.277 INFO:teuthology.orchestra.run.smithi053.stdout: "repo_digests": [ 2024-09-15T03:15:48.277 INFO:teuthology.orchestra.run.smithi053.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b74feaf32e117a824018a514c6386b2ab812fa0078f0a1365fcf1c4c7be8bdac" 2024-09-15T03:15:48.278 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2024-09-15T03:15:48.278 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-09-15T03:15:48.301 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph 2024-09-15T03:15:48.316 DEBUG:teuthology.orchestra.run.smithi104:> sudo mkdir -p /etc/ceph 2024-09-15T03:15:48.333 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /etc/ceph 2024-09-15T03:15:48.376 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 777 /etc/ceph 2024-09-15T03:15:48.391 INFO:tasks.cephadm:Writing seed config... 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T03:15:48.393 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T03:15:48.394 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:15:48.394 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T03:15:48.425 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = aed93852-7310-11ef-bceb-c7b262605968 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-15T03:15:48.425 DEBUG:teuthology.orchestra.run.smithi053:mon.a> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T03:15:48.470 DEBUG:teuthology.orchestra.run.smithi053:mgr.y> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T03:15:48.513 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T03:15:48.513 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f -v bootstrap --fsid aed93852-7310-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.53 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T03:15:48.728 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2024-09-15T03:15:48.728 INFO:teuthology.orchestra.run.smithi053.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f', '-v', 'bootstrap', '--fsid', 'aed93852-7310-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.53', '--skip-admin-label'] 2024-09-15T03:15:48.729 INFO:teuthology.orchestra.run.smithi053.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T03:15:48.729 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying podman|docker is present... 2024-09-15T03:15:48.729 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying lvm2 is present... 2024-09-15T03:15:48.729 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying time synchronization is in place... 2024-09-15T03:15:48.735 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T03:15:48.735 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T03:15:48.741 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T03:15:48.741 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.747 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-15T03:15:48.747 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-15T03:15:48.752 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-15T03:15:48.753 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.759 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-15T03:15:48.759 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout masked 2024-09-15T03:15:48.764 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-15T03:15:48.764 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.769 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-15T03:15:48.769 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-15T03:15:48.775 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-15T03:15:48.775 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.780 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout enabled 2024-09-15T03:15:48.785 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout active 2024-09-15T03:15:48.785 INFO:teuthology.orchestra.run.smithi053.stdout:Unit ntp.service is enabled and running 2024-09-15T03:15:48.786 INFO:teuthology.orchestra.run.smithi053.stdout:Repeating the final host check... 2024-09-15T03:15:48.786 INFO:teuthology.orchestra.run.smithi053.stdout:docker (/usr/bin/docker) is present 2024-09-15T03:15:48.786 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl is present 2024-09-15T03:15:48.787 INFO:teuthology.orchestra.run.smithi053.stdout:lvcreate is present 2024-09-15T03:15:48.791 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T03:15:48.791 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T03:15:48.797 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T03:15:48.797 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.803 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-09-15T03:15:48.803 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-09-15T03:15:48.809 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-09-15T03:15:48.809 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.815 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-09-15T03:15:48.815 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout masked 2024-09-15T03:15:48.820 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-09-15T03:15:48.820 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.826 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-09-15T03:15:48.826 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-09-15T03:15:48.831 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-09-15T03:15:48.831 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout inactive 2024-09-15T03:15:48.837 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout enabled 2024-09-15T03:15:48.843 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stdout active 2024-09-15T03:15:48.843 INFO:teuthology.orchestra.run.smithi053.stdout:Unit ntp.service is enabled and running 2024-09-15T03:15:48.843 INFO:teuthology.orchestra.run.smithi053.stdout:Host looks OK 2024-09-15T03:15:48.843 INFO:teuthology.orchestra.run.smithi053.stdout:Cluster fsid: aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:15:48.844 INFO:teuthology.orchestra.run.smithi053.stdout:Acquiring lock 140199395474400 on /run/cephadm/aed93852-7310-11ef-bceb-c7b262605968.lock 2024-09-15T03:15:48.844 INFO:teuthology.orchestra.run.smithi053.stdout:Lock 140199395474400 acquired on /run/cephadm/aed93852-7310-11ef-bceb-c7b262605968.lock 2024-09-15T03:15:48.844 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying IP 172.21.15.53 port 3300 ... 2024-09-15T03:15:48.844 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying IP 172.21.15.53 port 6789 ... 2024-09-15T03:15:48.844 INFO:teuthology.orchestra.run.smithi053.stdout:Base mon IP(s) is [172.21.15.53:3300, 172.21.15.53:6789], mon addrv is [v2:172.21.15.53:3300,v1:172.21.15.53:6789] 2024-09-15T03:15:48.849 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 2024-09-15T03:15:48.849 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-09-15T03:15:48.849 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.53 2024-09-15T03:15:48.854 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T03:15:48.854 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-15T03:15:48.854 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1789sec hoplimit 64 pref medium 2024-09-15T03:15:48.857 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T03:15:48.857 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T03:15:48.857 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T03:15:48.857 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-15T03:15:48.859 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:3718/64 scope link 2024-09-15T03:15:48.860 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T03:15:48.860 INFO:teuthology.orchestra.run.smithi053.stdout:Mon IP `172.21.15.53` is in CIDR network `172.21.0.0/20` 2024-09-15T03:15:48.860 INFO:teuthology.orchestra.run.smithi053.stdout:Mon IP `172.21.15.53` is in CIDR network `172.21.0.0/20` 2024-09-15T03:15:48.860 INFO:teuthology.orchestra.run.smithi053.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T03:15:48.860 INFO:teuthology.orchestra.run.smithi053.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T03:15:48.860 INFO:teuthology.orchestra.run.smithi053.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f... 2024-09-15T03:15:48.870 INFO:journalctl@ceph.mon.a.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:15:48.885 INFO:journalctl@ceph.mgr.y.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:15:49.226 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/docker: stdout d75f23820806da622f561ee5ee7551015285993f: Pulling from ceph-ci/ceph 2024-09-15T03:15:49.226 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/docker: stdout Digest: sha256:b74feaf32e117a824018a514c6386b2ab812fa0078f0a1365fcf1c4c7be8bdac 2024-09-15T03:15:49.226 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f 2024-09-15T03:15:49.226 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f 2024-09-15T03:15:50.925 INFO:teuthology.orchestra.run.smithi053.stdout:ceph: stdout ceph version 17.2.7-1643-gd75f2382 (d75f23820806da622f561ee5ee7551015285993f) quincy (stable) 2024-09-15T03:15:50.925 INFO:teuthology.orchestra.run.smithi053.stdout:Ceph version: ceph version 17.2.7-1643-gd75f2382 (d75f23820806da622f561ee5ee7551015285993f) quincy (stable) 2024-09-15T03:15:50.925 INFO:teuthology.orchestra.run.smithi053.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T03:15:52.445 INFO:teuthology.orchestra.run.smithi053.stdout:stat: stdout 167 167 2024-09-15T03:15:52.445 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial keys... 2024-09-15T03:15:53.891 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQBpUeZmWA3WGBAA0abWcV5G8ObrlrGqC66efg== 2024-09-15T03:15:55.399 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQBqUeZmivuiNRAAPL0TQ2+lqR5UCVZot3j29w== 2024-09-15T03:15:57.013 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-authtool: stdout AQBsUeZmpnB4FhAAQRiGFVnioRu4umtOSZrh7g== 2024-09-15T03:15:57.015 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial monmap... 2024-09-15T03:15:58.582 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T03:15:58.582 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-15T03:15:58.582 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:15:58.582 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T03:15:58.582 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool for a [v2:172.21.15.53:3300,v1:172.21.15.53:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T03:15:58.582 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = octopus 2024-09-15T03:15:58.582 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: set fsid to aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:15:58.583 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T03:15:58.583 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:15:58.583 INFO:teuthology.orchestra.run.smithi053.stdout:Creating mon... 2024-09-15T03:16:00.113 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-15T03:16:00.113 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 1 imported monmap: 2024-09-15T03:16:00.113 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-09-15T03:16:00.113 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr fsid aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:00.113 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-09-15T03:15:57.975029+0000 2024-09-15T03:16:00.113 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr created 2024-09-15T03:15:57.975029+0000 2024-09-15T03:16:00.114 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr min_mon_release 15 (octopus) 2024-09-15T03:16:00.115 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-09-15T03:16:00.115 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-09-15T03:16:00.115 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.115 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 0 /usr/bin/ceph-mon: set fsid to aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: RocksDB version: 6.15.5 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Compile date Sep 14 2024 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: DB SUMMARY 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: DB Session ID: OTDOEZ5HAH0G20TDYVI5 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.116 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.error_if_exists: 0 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.create_if_missing: 1 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.paranoid_checks: 1 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.env: 0x5645d25ea440 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.fs: Posix File System 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.info_log: 0x5645d397e660 2024-09-15T03:16:00.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.statistics: (nil) 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.use_fsync: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_log_file_size: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.allow_fallocate: 1 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.use_direct_reads: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T03:16:00.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.create_missing_column_families: 0 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.db_log_dir: 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.advise_random_on_open: 1 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.write_buffer_manager: 0x5645d39c7e90 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T03:16:00.145 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.rate_limiter: (nil) 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.unordered_write: 0 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.row_cache: None 2024-09-15T03:16:00.146 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.wal_filter: None 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.preserve_deletes: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.two_write_queues: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.manual_wal_flush: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.atomic_flush: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.log_readahead_size: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-15T03:16:00.147 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_background_jobs: 2 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_background_compactions: -1 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_subcompactions: 1 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_total_wal_size: 0 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T03:16:00.148 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_open_files: -1 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.bytes_per_sync: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Options.max_background_flushes: -1 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Compression algorithms supported: 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kZSTD supported: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kXpressCompression supported: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kBZip2Compression supported: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T03:16:00.149 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kLZ4Compression supported: 1 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kZlibCompression supported: 1 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: kSnappyCompression supported: 1 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: [db/db_impl/db_impl_open.cc:281] Creating manifest 1 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.529+0000 7f7e8f11b900 4 rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.merge_operator: 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_filter: None 2024-09-15T03:16:00.150 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_filter_factory: None 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5645d391eee0) 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr hash_index_allow_collision: 1 2024-09-15T03:16:00.151 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr checksum: 1 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x5645d39571f0 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-09-15T03:16:00.152 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr filter_policy: rocksdb.BuiltinBloomFilter 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr format_version: 4 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-15T03:16:00.153 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression: NoCompression 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.num_levels: 7 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:16:00.154 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression_opts.level: 32767 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compression_opts.enabled: false 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T03:16:00.155 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.arena_block_size: 4194304 2024-09-15T03:16:00.156 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T03:16:00.157 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.inplace_update_support: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.bloom_locality: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.max_successive_merges: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.force_consistency_checks: 1 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.ttl: 2592000 2024-09-15T03:16:00.158 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.enable_blob_files: false 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.min_blob_size: 0 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.blob_file_size: 268435456 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: [db/version_set.cc:4082] Creating manifest 3 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.159 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x5645d3988700 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e8f11b900 4 rocksdb: DB pointer 0x5645d395a000 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e868a9640 4 rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.533+0000 7f7e868a9640 4 rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:00.160 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:00.161 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:00.162 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.537+0000 7f7e8f11b900 4 rocksdb: [db/db_impl/db_impl.cc:446] Shutdown: canceling all background work 2024-09-15T03:16:00.163 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.537+0000 7f7e8f11b900 4 rocksdb: [db/db_impl/db_impl.cc:625] Shutdown complete 2024-09-15T03:16:00.164 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph-mon: stderr debug 2024-09-15T03:15:59.537+0000 7f7e8f11b900 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-09-15T03:16:00.164 INFO:teuthology.orchestra.run.smithi053.stdout:create mon.a on 2024-09-15T03:16:00.575 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-09-15T03:16:00.788 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-aed93852-7310-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-aed93852-7310-11ef-bceb-c7b262605968.target. 2024-09-15T03:16:00.788 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-aed93852-7310-11ef-bceb-c7b262605968.target -> /etc/systemd/system/ceph-aed93852-7310-11ef-bceb-c7b262605968.target. 2024-09-15T03:16:01.046 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a 2024-09-15T03:16:01.046 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to reset failed state of unit ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T03:16:01.266 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-aed93852-7310-11ef-bceb-c7b262605968.target.wants/ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a.service -> /etc/systemd/system/ceph-aed93852-7310-11ef-bceb-c7b262605968@.service. 2024-09-15T03:16:01.280 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld does not appear to be present 2024-09-15T03:16:01.280 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T03:16:01.280 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mon to start... 2024-09-15T03:16:01.281 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mon... 2024-09-15T03:16:01.405 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:01 smithi053 systemd[1]: Started Ceph mon.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:16:03.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:02 smithi053 bash[14566]: cluster 2024-09-15T03:16:02.948378+0000 mon.a (mon.0) 0 : cluster [INF] mkfs aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:03.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:02 smithi053 bash[14566]: cluster 2024-09-15T03:16:02.941550+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T03:16:03.686 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T03:16:03.686 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout id: aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:03.687 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T03:16:03.687 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:03.687 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout services: 2024-09-15T03:16:03.687 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.168936s) 2024-09-15T03:16:03.687 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T03:16:03.687 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T03:16:03.688 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:03.688 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout data: 2024-09-15T03:16:03.688 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T03:16:03.689 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T03:16:03.689 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T03:16:03.689 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T03:16:03.689 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:03.689 INFO:teuthology.orchestra.run.smithi053.stdout:mon is available 2024-09-15T03:16:03.689 INFO:teuthology.orchestra.run.smithi053.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T03:16:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:03 smithi053 bash[14566]: cluster 2024-09-15T03:16:02.947309+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T03:16:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:03 smithi053 bash[14566]: cluster 2024-09-15T03:16:02.947475+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:16:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:03 smithi053 bash[14566]: cluster 2024-09-15T03:16:02.950057+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-09-15T03:16:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:03 smithi053 bash[14566]: cluster 2024-09-15T03:16:02.952718+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-15T03:16:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:03 smithi053 bash[14566]: cluster 2024-09-15T03:16:02.953170+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-09-15T03:16:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:03 smithi053 bash[14566]: audit 2024-09-15T03:16:03.116165+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.53:0/852214500' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-15T03:16:05.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:04 smithi053 bash[14566]: audit 2024-09-15T03:16:04.829275+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.53:0/1240039559' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T03:16:05.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:04 smithi053 bash[14566]: audit 2024-09-15T03:16:04.835479+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.53:0/1240039559' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T03:16:05.420 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout fsid = aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.53:3300,v1:172.21.15.53:6789] 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = True 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:05.421 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T03:16:05.422 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T03:16:05.422 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T03:16:05.422 INFO:teuthology.orchestra.run.smithi053.stdout:Generating new minimal ceph.conf... 2024-09-15T03:16:06.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:06 smithi053 bash[14566]: audit 2024-09-15T03:16:06.568522+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.53:0/3162961643' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:16:07.139 INFO:teuthology.orchestra.run.smithi053.stdout:Restarting the monitor... 2024-09-15T03:16:07.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:07 smithi053 systemd[1]: Stopping Ceph mon.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:16:07.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:07 smithi053 bash[14566]: debug 2024-09-15T03:16:07.289+0000 7f924c92e640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-15T03:16:07.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:07 smithi053 bash[14566]: debug 2024-09-15T03:16:07.289+0000 7f924c92e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T03:16:08.082 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:07 smithi053 bash[14974]: ceph-aed93852-7310-11ef-bceb-c7b262605968-mon-a 2024-09-15T03:16:08.113 INFO:teuthology.orchestra.run.smithi053.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T03:16:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:08 smithi053 bash[15035]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-mon-a 2024-09-15T03:16:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:08 smithi053 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a.service: Succeeded. 2024-09-15T03:16:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:08 smithi053 systemd[1]: Stopped Ceph mon.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:16:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:08 smithi053 systemd[1]: Started Ceph mon.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:16:09.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.681+0000 7f9325564900 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-15T03:16:09.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.681+0000 7f9325564900 0 ceph version 17.2.7-1643-gd75f2382 (d75f23820806da622f561ee5ee7551015285993f) quincy (stable), process ceph-mon, pid 7 2024-09-15T03:16:09.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.681+0000 7f9325564900 0 pidfile_write: ignore empty --pid-file 2024-09-15T03:16:09.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.689+0000 7f9325564900 0 load: jerasure load: lrc 2024-09-15T03:16:09.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: RocksDB version: 6.15.5 2024-09-15T03:16:09.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Compile date Sep 14 2024 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: DB SUMMARY 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: DB Session ID: 7TK5YX1T2BCM43SYNT6H 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: CURRENT file: CURRENT 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: IDENTITY file: IDENTITY 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 82866 ; 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.error_if_exists: 0 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.create_if_missing: 0 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.paranoid_checks: 1 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T03:16:09.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.env: 0x55e5b6093440 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.fs: Posix File System 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.info_log: 0x55e5b85faee0 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.statistics: (nil) 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.use_fsync: 0 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_log_file_size: 0 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.allow_fallocate: 1 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-15T03:16:09.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.use_direct_reads: 0 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.create_missing_column_families: 0 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.db_log_dir: 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.advise_random_on_open: 1 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-15T03:16:09.916 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.write_buffer_manager: 0x55e5b86b87e0 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.rate_limiter: (nil) 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.unordered_write: 0 2024-09-15T03:16:09.917 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.row_cache: None 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.wal_filter: None 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.preserve_deletes: 0 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.two_write_queues: 0 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.manual_wal_flush: 0 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.atomic_flush: 0 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T03:16:09.918 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.log_readahead_size: 0 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_background_jobs: 2 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_background_compactions: -1 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_subcompactions: 1 2024-09-15T03:16:09.919 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_total_wal_size: 0 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_open_files: -1 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bytes_per_sync: 0 2024-09-15T03:16:09.921 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_background_flushes: -1 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Compression algorithms supported: 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kZSTD supported: 0 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kXpressCompression supported: 0 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kBZip2Compression supported: 0 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kLZ4Compression supported: 1 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kZlibCompression supported: 1 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: kSnappyCompression supported: 1 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T03:16:09.922 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.merge_operator: 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_filter: None 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_filter_factory: None 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e5b85a3a38) 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: cache_index_and_filter_blocks: 1 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: pin_top_level_index_and_filter: 1 2024-09-15T03:16:09.923 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: index_type: 0 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: data_block_index_type: 0 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: index_shortening: 1 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: data_block_hash_table_util_ratio: 0.750000 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: hash_index_allow_collision: 1 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: checksum: 1 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: no_block_cache: 0 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_cache: 0x55e5b85d71f0 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_cache_name: BinnedLRUCache 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_cache_options: 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: capacity : 536870912 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: num_shard_bits : 4 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: strict_capacity_limit : 0 2024-09-15T03:16:09.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: high_pri_pool_ratio: 0.000 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_cache_compressed: (nil) 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: persistent_cache: (nil) 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_size: 4096 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_size_deviation: 10 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_restart_interval: 16 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: index_block_restart_interval: 1 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: metadata_block_size: 4096 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: partition_filters: 0 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: use_delta_encoding: 1 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: whole_key_filtering: 1 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: verify_compression: 0 2024-09-15T03:16:09.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: read_amp_bytes_per_bit: 0 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: format_version: 4 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: enable_index_compression: 1 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: block_align: 0 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression: NoCompression 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T03:16:09.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.num_levels: 7 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T03:16:09.927 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression_opts.level: 32767 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compression_opts.enabled: false 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T03:16:09.928 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T03:16:09.929 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.arena_block_size: 4194304 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T03:16:09.930 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.inplace_update_support: 0 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T03:16:09.931 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.bloom_locality: 0 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.max_successive_merges: 0 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.force_consistency_checks: 1 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.ttl: 2592000 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.enable_blob_files: false 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.min_blob_size: 0 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.blob_file_size: 268435456 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T03:16:09.932 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370169699602, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 4 rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.693+0000 7f9325564900 3 rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370169700592, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79596, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77828, "index_size": 230, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 9759, "raw_average_key_size": 47, "raw_value_size": 72235, "raw_average_value_size": 348, "num_data_blocks": 10, "num_entries": 207, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726370169, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "a352f5cd-8b50-4bc7-b658-2cfab6d4e065", "db_session_id": "7TK5YX1T2BCM43SYNT6H"}} 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 4 rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370169701059, "job": 1, "event": "recovery_finished"} 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 4 rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 4 rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55e5b860c700 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 4 rocksdb: DB pointer 0x55e5b85da000 2024-09-15T03:16:09.933 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 0 starting mon.a rank 0 at public addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] at bind addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f931b330640 4 rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f931b330640 4 rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ** DB Stats ** 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ** Compaction Stats [default] ** 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:09.934 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: L0 2/0 79.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.7 0.00 0.00 1 0.001 0 0 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Sum 2/0 79.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.7 0.00 0.00 1 0.001 0 0 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.7 0.00 0.00 1 0.001 0 0 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ** Compaction Stats [default] ** 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 109.7 0.00 0.00 1 0.001 0 0 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:16:09.935 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Cumulative compaction: 0.00 GB write, 13.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Interval compaction: 0.00 GB write, 13.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ** Compaction Stats [default] ** 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: L0 2/0 79.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.7 0.00 0.00 1 0.001 0 0 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Sum 2/0 79.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 109.7 0.00 0.00 1 0.001 0 0 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ** Compaction Stats [default] ** 2024-09-15T03:16:09.936 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 109.7 0.00 0.00 1 0.001 0 0 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:16:09.937 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Cumulative compaction: 0.00 GB write, 13.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 1 mon.a@-1(???) e1 preinit fsid aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 0 mon.a@-1(???).mds e1 new map 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 0 mon.a@-1(???).mds e1 print_map 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: e1 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: legacy client fscid: -1 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: No filesystems configured 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:16:09.938 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:16:09.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:16:09.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: debug 2024-09-15T03:16:09.697+0000 7f9325564900 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T03:16:09.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: cluster 2024-09-15T03:16:09.724855+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T03:16:09.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: cluster 2024-09-15T03:16:09.724915+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:16:09.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: cluster 2024-09-15T03:16:09.725321+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-09-15T03:16:09.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: cluster 2024-09-15T03:16:09.725343+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-09-15T03:16:09.939 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:09 smithi053 bash[15077]: cluster 2024-09-15T03:16:09.725718+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-09-15T03:16:10.446 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T03:16:10.446 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T03:16:10.446 INFO:teuthology.orchestra.run.smithi053.stdout:Creating mgr... 2024-09-15T03:16:10.447 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T03:16:10.447 INFO:teuthology.orchestra.run.smithi053.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T03:16:10.685 INFO:teuthology.orchestra.run.smithi053.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.y 2024-09-15T03:16:10.685 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Failed to reset failed state of unit ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.y.service: Unit ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.y.service not loaded. 2024-09-15T03:16:10.912 INFO:teuthology.orchestra.run.smithi053.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-aed93852-7310-11ef-bceb-c7b262605968.target.wants/ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.y.service -> /etc/systemd/system/ceph-aed93852-7310-11ef-bceb-c7b262605968@.service. 2024-09-15T03:16:10.925 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld does not appear to be present 2024-09-15T03:16:10.925 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T03:16:10.926 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld does not appear to be present 2024-09-15T03:16:10.926 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T03:16:10.926 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr to start... 2024-09-15T03:16:10.926 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr... 2024-09-15T03:16:11.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:10 smithi053 bash[15077]: audit 2024-09-15T03:16:09.887941+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.53:0/1269570784' entity='client.admin' 2024-09-15T03:16:12.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:12 smithi053 bash[15077]: audit 2024-09-15T03:16:12.729236+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.53:0/1329055378' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T03:16:12.940 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:12 smithi053 bash[15335]: debug 2024-09-15T03:16:12.669+0000 7ffb08296ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "aed93852-7310-11ef-bceb-c7b262605968", 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:13.294 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:13.295 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T03:16:13.296 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:13.296 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T03:16:13.296 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T03:16:13.296 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T03:16:13.296 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T03:16:13.296 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T03:16:13.296 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T03:16:13.299 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:13.299 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T03:16:13.300 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:13.301 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T03:16:02.948903+0000", 2024-09-15T03:16:13.302 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T03:16:13.302 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:13.302 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T03:16:13.302 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-15T03:16:13.302 INFO:teuthology.orchestra.run.smithi053.stdout:mgr not available, waiting (1/15)... 2024-09-15T03:16:13.775 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:13 smithi053 bash[15335]: debug 2024-09-15T03:16:13.473+0000 7ffb08296ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T03:16:13.775 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:13 smithi053 bash[15335]: debug 2024-09-15T03:16:13.541+0000 7ffb08296ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T03:16:13.775 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:13 smithi053 bash[15335]: debug 2024-09-15T03:16:13.613+0000 7ffb08296ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T03:16:14.032 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:13 smithi053 bash[15335]: debug 2024-09-15T03:16:13.769+0000 7ffb08296ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:16:14.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:14 smithi053 bash[15335]: debug 2024-09-15T03:16:14.025+0000 7ffb08296ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T03:16:14.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:14 smithi053 bash[15335]: debug 2024-09-15T03:16:14.093+0000 7ffb08296ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T03:16:14.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:14 smithi053 bash[15335]: debug 2024-09-15T03:16:14.229+0000 7ffb08296ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T03:16:15.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:14 smithi053 bash[15335]: debug 2024-09-15T03:16:14.893+0000 7ffb08296ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T03:16:15.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:14 smithi053 bash[15335]: debug 2024-09-15T03:16:14.965+0000 7ffb08296ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T03:16:15.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:15 smithi053 bash[15335]: debug 2024-09-15T03:16:15.045+0000 7ffb08296ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T03:16:15.689 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:15 smithi053 bash[15335]: debug 2024-09-15T03:16:15.337+0000 7ffb08296ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T03:16:15.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:15 smithi053 bash[15335]: debug 2024-09-15T03:16:15.485+0000 7ffb08296ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T03:16:16.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:15 smithi053 bash[15335]: debug 2024-09-15T03:16:15.809+0000 7ffb08296ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T03:16:16.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15335]: debug 2024-09-15T03:16:16.033+0000 7ffb08296ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:16:16.552 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15335]: debug 2024-09-15T03:16:16.481+0000 7ffb08296ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T03:16:16.811 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15077]: audit 2024-09-15T03:16:16.573466+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.53:0/1975730789' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T03:16:16.812 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15335]: debug 2024-09-15T03:16:16.545+0000 7ffb08296ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T03:16:16.812 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15335]: debug 2024-09-15T03:16:16.621+0000 7ffb08296ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T03:16:16.812 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15335]: debug 2024-09-15T03:16:16.721+0000 7ffb08296ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T03:16:16.812 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15335]: debug 2024-09-15T03:16:16.789+0000 7ffb08296ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T03:16:17.114 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:16 smithi053 bash[15335]: debug 2024-09-15T03:16:16.873+0000 7ffb08296ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T03:16:17.114 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:17 smithi053 bash[15335]: debug 2024-09-15T03:16:17.025+0000 7ffb08296ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T03:16:17.137 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:17.137 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-15T03:16:17.137 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "aed93852-7310-11ef-bceb-c7b262605968", 2024-09-15T03:16:17.137 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T03:16:17.137 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T03:16:17.137 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T03:16:17.137 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T03:16:17.138 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T03:16:17.139 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T03:16:17.142 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:17.142 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T03:16:17.142 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T03:16:17.142 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T03:16:17.142 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T03:16:17.143 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T03:16:02.948903+0000", 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T03:16:17.144 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-15T03:16:17.145 INFO:teuthology.orchestra.run.smithi053.stdout:mgr not available, waiting (2/15)... 2024-09-15T03:16:17.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:17 smithi053 bash[15335]: debug 2024-09-15T03:16:17.109+0000 7ffb08296ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15335]: debug 2024-09-15T03:16:18.109+0000 7ffb08296ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: cluster 2024-09-15T03:16:18.134779+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: cluster 2024-09-15T03:16:18.141571+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00702689s) 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: audit 2024-09-15T03:16:18.143705+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: audit 2024-09-15T03:16:18.143961+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: audit 2024-09-15T03:16:18.144195+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: audit 2024-09-15T03:16:18.144485+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:16:18.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: audit 2024-09-15T03:16:18.145261+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T03:16:18.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:18 smithi053 bash[15077]: cluster 2024-09-15T03:16:18.173146+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2024-09-15T03:16:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:19 smithi053 bash[15077]: audit 2024-09-15T03:16:18.197626+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-15T03:16:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:19 smithi053 bash[15077]: audit 2024-09-15T03:16:18.202066+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-15T03:16:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:19 smithi053 bash[15077]: audit 2024-09-15T03:16:18.206978+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' 2024-09-15T03:16:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:19 smithi053 bash[15077]: audit 2024-09-15T03:16:18.210468+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' 2024-09-15T03:16:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:19 smithi053 bash[15077]: audit 2024-09-15T03:16:18.213236+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.53:0/2450046318' entity='mgr.y' 2024-09-15T03:16:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:19 smithi053 bash[15077]: cluster 2024-09-15T03:16:19.150854+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01631s) 2024-09-15T03:16:21.274 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:21.274 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsid": "aed93852-7310-11ef-bceb-c7b262605968", 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 0 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T03:16:21.275 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T03:16:21.276 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T03:16:21.277 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T03:16:21.278 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ], 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T03:16:02.948903+0000", 2024-09-15T03:16:21.279 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T03:16:21.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout }, 2024-09-15T03:16:21.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T03:16:21.280 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-15T03:16:21.280 INFO:teuthology.orchestra.run.smithi053.stdout:mgr is available 2024-09-15T03:16:21.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:21 smithi053 bash[15077]: cluster 2024-09-15T03:16:20.193691+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-09-15T03:16:21.479 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:21 smithi053 bash[15077]: audit 2024-09-15T03:16:20.742103+0000 mon.a (mon.0) 24 : audit [DBG] from='client.? 172.21.15.53:0/3258934990' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T03:16:23.189 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:22 smithi053 bash[15077]: audit 2024-09-15T03:16:22.708203+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.53:0/490167110' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T03:16:23.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:22 smithi053 bash[15077]: audit 2024-09-15T03:16:22.712479+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.53:0/490167110' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T03:16:23.234 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:23.234 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T03:16:23.234 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout fsid = aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:23.234 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-15T03:16:23.234 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T03:16:23.234 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T03:16:23.235 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling cephadm module... 2024-09-15T03:16:25.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:24 smithi053 bash[15077]: audit 2024-09-15T03:16:24.725634+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.53:0/1836021952' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T03:16:25.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:24 smithi053 bash[15335]: ignoring --setuser ceph since I am not root 2024-09-15T03:16:25.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:24 smithi053 bash[15335]: ignoring --setgroup ceph since I am not root 2024-09-15T03:16:25.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:24 smithi053 bash[15335]: debug 2024-09-15T03:16:24.945+0000 7f9248733ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T03:16:26.024 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:25 smithi053 bash[15335]: debug 2024-09-15T03:16:25.717+0000 7f9248733ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T03:16:26.024 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:25 smithi053 bash[15335]: debug 2024-09-15T03:16:25.789+0000 7f9248733ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T03:16:26.024 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:25 smithi053 bash[15335]: debug 2024-09-15T03:16:25.857+0000 7f9248733ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T03:16:26.024 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:26 smithi053 bash[15335]: debug 2024-09-15T03:16:26.017+0000 7f9248733ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:16:26.024 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:25 smithi053 bash[15077]: audit 2024-09-15T03:16:24.780958+0000 mon.a (mon.0) 28 : audit [INF] from='client.? 172.21.15.53:0/1836021952' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T03:16:26.024 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:25 smithi053 bash[15077]: cluster 2024-09-15T03:16:24.781049+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e5: y(active, since 6s) 2024-09-15T03:16:26.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:26 smithi053 bash[15335]: debug 2024-09-15T03:16:26.281+0000 7f9248733ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T03:16:26.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:26 smithi053 bash[15335]: debug 2024-09-15T03:16:26.349+0000 7f9248733ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T03:16:26.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:26 smithi053 bash[15335]: debug 2024-09-15T03:16:26.493+0000 7f9248733ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T03:16:27.171 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:26 smithi053 bash[15077]: audit 2024-09-15T03:16:26.800200+0000 mon.a (mon.0) 30 : audit [DBG] from='client.? 172.21.15.53:0/1263590061' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T03:16:27.324 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:27 smithi053 bash[15335]: debug 2024-09-15T03:16:27.165+0000 7f9248733ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T03:16:27.324 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:27 smithi053 bash[15335]: debug 2024-09-15T03:16:27.241+0000 7f9248733ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T03:16:27.406 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-15T03:16:27.406 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T03:16:27.406 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T03:16:27.406 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-15T03:16:27.407 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T03:16:27.407 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-15T03:16:27.407 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for the mgr to restart... 2024-09-15T03:16:27.407 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr epoch 5... 2024-09-15T03:16:27.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:27 smithi053 bash[15335]: debug 2024-09-15T03:16:27.317+0000 7f9248733ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T03:16:27.769 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:27 smithi053 bash[15335]: debug 2024-09-15T03:16:27.617+0000 7f9248733ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T03:16:28.098 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:27 smithi053 bash[15335]: debug 2024-09-15T03:16:27.765+0000 7f9248733ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T03:16:28.098 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:28 smithi053 bash[15335]: debug 2024-09-15T03:16:28.093+0000 7f9248733ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T03:16:28.361 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:28 smithi053 bash[15335]: debug 2024-09-15T03:16:28.317+0000 7f9248733ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:16:29.070 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:28 smithi053 bash[15335]: debug 2024-09-15T03:16:28.765+0000 7f9248733ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T03:16:29.071 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:28 smithi053 bash[15335]: debug 2024-09-15T03:16:28.833+0000 7f9248733ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T03:16:29.071 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:28 smithi053 bash[15335]: debug 2024-09-15T03:16:28.901+0000 7f9248733ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T03:16:29.071 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:29 smithi053 bash[15335]: debug 2024-09-15T03:16:28.997+0000 7f9248733ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T03:16:29.071 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:29 smithi053 bash[15335]: debug 2024-09-15T03:16:29.065+0000 7f9248733ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T03:16:29.386 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:29 smithi053 bash[15335]: debug 2024-09-15T03:16:29.141+0000 7f9248733ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T03:16:29.387 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:29 smithi053 bash[15335]: debug 2024-09-15T03:16:29.301+0000 7f9248733ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T03:16:29.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:29 smithi053 bash[15335]: debug 2024-09-15T03:16:29.381+0000 7f9248733ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15335]: debug 2024-09-15T03:16:30.389+0000 7f9248733ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: cluster 2024-09-15T03:16:30.414733+0000 mon.a (mon.0) 31 : cluster [INF] Active manager daemon y restarted 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: cluster 2024-09-15T03:16:30.415277+0000 mon.a (mon.0) 32 : cluster [INF] Activating manager daemon y 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: cluster 2024-09-15T03:16:30.421357+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: cluster 2024-09-15T03:16:30.421598+0000 mon.a (mon.0) 34 : cluster [DBG] mgrmap e6: y(active, starting, since 0.00649361s) 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: audit 2024-09-15T03:16:30.423350+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: audit 2024-09-15T03:16:30.425020+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: audit 2024-09-15T03:16:30.425889+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T03:16:30.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: audit 2024-09-15T03:16:30.426053+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T03:16:30.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: audit 2024-09-15T03:16:30.426217+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T03:16:30.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:30 smithi053 bash[15077]: cluster 2024-09-15T03:16:30.452254+0000 mon.a (mon.0) 40 : cluster [INF] Manager daemon y is now available 2024-09-15T03:16:31.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: cephadm 2024-09-15T03:16:30.469419+0000 mgr.y (mgr.14118) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-09-15T03:16:31.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: audit 2024-09-15T03:16:30.473226+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:31.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: audit 2024-09-15T03:16:30.478471+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:31.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: audit 2024-09-15T03:16:30.481142+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:31.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: audit 2024-09-15T03:16:30.486449+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:16:31.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: audit 2024-09-15T03:16:30.492307+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:16:31.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: audit 2024-09-15T03:16:30.507205+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-15T03:16:31.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: audit 2024-09-15T03:16:30.511337+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-15T03:16:31.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:31 smithi053 bash[15077]: cluster 2024-09-15T03:16:31.427151+0000 mon.a (mon.0) 48 : cluster [DBG] mgrmap e7: y(active, since 1.01204s) 2024-09-15T03:16:32.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-15T03:16:32.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T03:16:32.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T03:16:32.003 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-15T03:16:32.003 INFO:teuthology.orchestra.run.smithi053.stdout:mgr epoch 5 is available 2024-09-15T03:16:32.003 INFO:teuthology.orchestra.run.smithi053.stdout:Setting orchestrator backend to cephadm... 2024-09-15T03:16:32.905 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:32 smithi053 bash[15077]: audit 2024-09-15T03:16:31.424918+0000 mgr.y (mgr.14118) 2 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T03:16:32.905 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:32 smithi053 bash[15077]: audit 2024-09-15T03:16:31.438748+0000 mgr.y (mgr.14118) 3 : audit [DBG] from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T03:16:33.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:33 smithi053 bash[15077]: cluster 2024-09-15T03:16:32.475816+0000 mon.a (mon.0) 49 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-09-15T03:16:33.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:33 smithi053 bash[15077]: audit 2024-09-15T03:16:33.473503+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:34.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15077]: audit 2024-09-15T03:16:33.465677+0000 mgr.y (mgr.14118) 4 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:16:34.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15077]: audit 2024-09-15T03:16:33.488596+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:16:34.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15077]: audit 2024-09-15T03:16:34.424208+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:34.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15077]: audit 2024-09-15T03:16:34.425539+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: debug 2024-09-15T03:16:34.417+0000 7f91faac7640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:03:16:34] ENGINE Error in HTTPServer.serve 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: Traceback (most recent call last): 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: self._connections.run(self.expiration_interval) 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: self._run(expiration_interval) 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: s = self.context.wrap_socket( 2024-09-15T03:16:34.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:16:34.692 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: return self.sslsocket_class._create( 2024-09-15T03:16:34.692 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:16:34.692 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: self.do_handshake() 2024-09-15T03:16:34.692 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:16:34.692 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: self._sslobj.do_handshake() 2024-09-15T03:16:34.692 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:34 smithi053 bash[15335]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:16:35.768 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: cephadm 2024-09-15T03:16:34.293994+0000 mgr.y (mgr.14118) 5 : cephadm [INF] [15/Sep/2024:03:16:34] ENGINE Bus STARTING 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: cephadm 2024-09-15T03:16:34.417355+0000 mgr.y (mgr.14118) 6 : cephadm [INF] [15/Sep/2024:03:16:34] ENGINE Serving on https://172.21.15.53:7150 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: cephadm 2024-09-15T03:16:34.417622+0000 mgr.y (mgr.14118) 7 : cephadm [INF] [15/Sep/2024:03:16:34] ENGINE Bus STARTED 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: cephadm 2024-09-15T03:16:34.420763+0000 mgr.y (mgr.14118) 8 : cephadm [ERR] [15/Sep/2024:03:16:34] ENGINE Error in HTTPServer.serve 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: Traceback (most recent call last): 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: self._connections.run(self.expiration_interval) 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: self._run(expiration_interval) 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:16:35.769 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: s = self.context.wrap_socket( 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: return self.sslsocket_class._create( 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: self.do_handshake() 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: self._sslobj.do_handshake() 2024-09-15T03:16:35.770 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:35 smithi053 bash[15077]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:16:36.136 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T03:16:36.137 INFO:teuthology.orchestra.run.smithi053.stdout:Generating ssh key... 2024-09-15T03:16:36.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:36 smithi053 bash[15077]: audit 2024-09-15T03:16:35.558824+0000 mgr.y (mgr.14118) 9 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:16:38.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: Generating public/private rsa key pair. 2024-09-15T03:16:38.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: Your identification has been saved in /tmp/tmpilbwphon/key 2024-09-15T03:16:38.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: Your public key has been saved in /tmp/tmpilbwphon/key.pub 2024-09-15T03:16:38.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: The key fingerprint is: 2024-09-15T03:16:38.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: SHA256:SSsnlfXz0EJK7yjRFq9Hmn0UX85IbEcYe5uXlcIhsmY ceph-aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:38.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: The key's randomart image is: 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: +---[RSA 3072]----+ 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | .+..o++o| 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | =oBoo=B+| 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | =E+ O+=o*| 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | oo= O *..=| 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | o S = + o+.| 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | + . . . .| 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | | 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | | 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: | | 2024-09-15T03:16:38.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:37 smithi053 bash[15335]: +----[SHA256]-----+ 2024-09-15T03:16:39.068 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:38 smithi053 bash[15077]: audit 2024-09-15T03:16:37.635154+0000 mgr.y (mgr.14118) 10 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:16:39.069 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:38 smithi053 bash[15077]: cephadm 2024-09-15T03:16:37.635429+0000 mgr.y (mgr.14118) 11 : cephadm [INF] Generating ssh key... 2024-09-15T03:16:39.069 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:38 smithi053 bash[15077]: audit 2024-09-15T03:16:37.707845+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:39.069 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:38 smithi053 bash[15077]: audit 2024-09-15T03:16:37.710895+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:39.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:39 smithi053 bash[15077]: audit 2024-09-15T03:16:39.615272+0000 mgr.y (mgr.14118) 12 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:16:40.190 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2aX2hATuzDig8oOIffTEgMhPMWmkYmbp+fSplT1QXKUXa1Ejv/tj6AB0qQWfU490sFofho6oWGWg0/gLpmgkL07AHpXYXe1sLcUzg/ow5jfUP3gbk3/3X4KyXfRLwvpjrNIzyY+DC6y8MgsjXGUXcCdj1c+7p5kTJElBJCWs3qFDqINIF0+C3wwadv01Pb/zEEdj1C06MxRivxT/p9RXoQw+yxiVD1NLOxIpzGY40V63PuNVSUIdGym6HE07Pqs43uptAzO5sdsHMu3rUT2EHrmrPlUiZ4bPkAJdxIUQqyWDj46yW7Wzl+Kory5A3UXx+GW9laioQCCM/DFxpOrqGPbSAy4S1PCdUWsu1tTUBYfjHCMPjlOWjL9F4iXDCl7OjmzsrblXwppPjqzdmAO3x0a3A18aDbv22FiWwENBM8G21MW01M117EPn82+P4UKSb9aIYp/zgH5aSn+l9h8CU3MwfRPKb6n9NdxyRiOoNRvzj+4MExcanuFfuxPRn4lk= ceph-aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:16:40.190 INFO:teuthology.orchestra.run.smithi053.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T03:16:40.191 INFO:teuthology.orchestra.run.smithi053.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T03:16:40.191 INFO:teuthology.orchestra.run.smithi053.stdout:Adding host smithi053... 2024-09-15T03:16:42.121 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:41 smithi053 bash[15077]: audit 2024-09-15T03:16:41.652733+0000 mgr.y (mgr.14118) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi053", "addr": "172.21.15.53", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:16:44.101 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:43 smithi053 bash[15077]: cephadm 2024-09-15T03:16:43.142478+0000 mgr.y (mgr.14118) 14 : cephadm [INF] Deploying cephadm binary to smithi053 2024-09-15T03:16:46.806 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Added host 'smithi053' with addr '172.21.15.53' 2024-09-15T03:16:46.806 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying unmanaged mon service... 2024-09-15T03:16:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:47 smithi053 bash[15077]: audit 2024-09-15T03:16:46.007115+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:47 smithi053 bash[15077]: cephadm 2024-09-15T03:16:46.007658+0000 mgr.y (mgr.14118) 15 : cephadm [INF] Added host smithi053 2024-09-15T03:16:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:47 smithi053 bash[15077]: audit 2024-09-15T03:16:46.008490+0000 mon.a (mon.0) 57 : audit [DBG] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:16:49.692 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T03:16:49.692 INFO:teuthology.orchestra.run.smithi053.stdout:Deploying unmanaged mgr service... 2024-09-15T03:16:50.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:50 smithi053 bash[15077]: audit 2024-09-15T03:16:49.071173+0000 mgr.y (mgr.14118) 16 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:16:50.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:50 smithi053 bash[15077]: cephadm 2024-09-15T03:16:49.074011+0000 mgr.y (mgr.14118) 17 : cephadm [INF] Saving service mon spec with placement count:5 2024-09-15T03:16:50.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:50 smithi053 bash[15077]: audit 2024-09-15T03:16:49.079175+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:50.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:50 smithi053 bash[15077]: audit 2024-09-15T03:16:49.325718+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:50.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:50 smithi053 bash[15077]: audit 2024-09-15T03:16:49.617965+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:51.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:51 smithi053 bash[15077]: cluster 2024-09-15T03:16:50.427636+0000 mgr.y (mgr.14118) 18 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:16:51.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:51 smithi053 bash[15077]: audit 2024-09-15T03:16:51.241803+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:51.861 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T03:16:52.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:52 smithi053 bash[15077]: audit 2024-09-15T03:16:51.236550+0000 mgr.y (mgr.14118) 19 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:16:52.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:52 smithi053 bash[15077]: cephadm 2024-09-15T03:16:51.238642+0000 mgr.y (mgr.14118) 20 : cephadm [INF] Saving service mgr spec with placement count:2 2024-09-15T03:16:53.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:53 smithi053 bash[15077]: cluster 2024-09-15T03:16:52.428110+0000 mgr.y (mgr.14118) 21 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:16:53.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:53 smithi053 bash[15077]: audit 2024-09-15T03:16:53.345374+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.53:0/2839271876' entity='client.admin' 2024-09-15T03:16:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: cluster 2024-09-15T03:16:54.428697+0000 mgr.y (mgr.14118) 22 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:16:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: audit 2024-09-15T03:16:54.696455+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: audit 2024-09-15T03:16:54.699602+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: audit 2024-09-15T03:16:54.700362+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:16:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: audit 2024-09-15T03:16:54.704723+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' 2024-09-15T03:16:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: audit 2024-09-15T03:16:54.706945+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi053", "caps": []}]: dispatch 2024-09-15T03:16:55.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: audit 2024-09-15T03:16:54.708807+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14118 172.21.15.53:0/3736023517' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi053", "caps": []}]': finished 2024-09-15T03:16:55.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:55 smithi053 bash[15077]: audit 2024-09-15T03:16:55.395564+0000 mon.a (mon.0) 69 : audit [INF] from='client.? 172.21.15.53:0/4036264042' entity='client.admin' 2024-09-15T03:16:56.045 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling the dashboard module... 2024-09-15T03:16:57.964 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:57 smithi053 bash[15335]: ignoring --setuser ceph since I am not root 2024-09-15T03:16:57.965 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:57 smithi053 bash[15335]: ignoring --setgroup ceph since I am not root 2024-09-15T03:16:57.965 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:57 smithi053 bash[15335]: debug 2024-09-15T03:16:57.856+0000 7f9a82356ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T03:16:57.965 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:57 smithi053 bash[15077]: cluster 2024-09-15T03:16:56.429259+0000 mgr.y (mgr.14118) 23 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:16:57.965 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:57 smithi053 bash[15077]: cephadm 2024-09-15T03:16:56.540021+0000 mgr.y (mgr.14118) 24 : cephadm [INF] Deploying daemon agent.smithi053 on smithi053 2024-09-15T03:16:57.965 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:57 smithi053 bash[15077]: audit 2024-09-15T03:16:57.669265+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.15.53:0/3223184550' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T03:16:58.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:58 smithi053 bash[15335]: debug 2024-09-15T03:16:58.624+0000 7f9a82356ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T03:16:59.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:58 smithi053 bash[15077]: audit 2024-09-15T03:16:57.699790+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.15.53:0/3223184550' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T03:16:59.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:58 smithi053 bash[15077]: cluster 2024-09-15T03:16:57.699854+0000 mon.a (mon.0) 72 : cluster [DBG] mgrmap e9: y(active, since 27s) 2024-09-15T03:16:59.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:58 smithi053 bash[15335]: debug 2024-09-15T03:16:58.692+0000 7f9a82356ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T03:16:59.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:58 smithi053 bash[15335]: debug 2024-09-15T03:16:58.768+0000 7f9a82356ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T03:16:59.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:58 smithi053 bash[15335]: debug 2024-09-15T03:16:58.932+0000 7f9a82356ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:16:59.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:59 smithi053 bash[15335]: debug 2024-09-15T03:16:59.200+0000 7f9a82356ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T03:16:59.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:59 smithi053 bash[15335]: debug 2024-09-15T03:16:59.268+0000 7f9a82356ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T03:16:59.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:16:59 smithi053 bash[15335]: debug 2024-09-15T03:16:59.412+0000 7f9a82356ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T03:17:00.173 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:16:59 smithi053 bash[15077]: audit 2024-09-15T03:16:59.832419+0000 mon.a (mon.0) 73 : audit [DBG] from='client.? 172.21.15.53:0/243725574' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T03:17:00.173 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:00 smithi053 bash[15335]: debug 2024-09-15T03:17:00.092+0000 7f9a82356ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T03:17:00.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:00 smithi053 bash[15335]: debug 2024-09-15T03:17:00.168+0000 7f9a82356ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T03:17:00.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:00 smithi053 bash[15335]: debug 2024-09-15T03:17:00.244+0000 7f9a82356ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T03:17:00.443 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-15T03:17:00.444 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T03:17:00.444 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T03:17:00.445 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-15T03:17:00.445 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T03:17:00.445 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-15T03:17:00.445 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for the mgr to restart... 2024-09-15T03:17:00.445 INFO:teuthology.orchestra.run.smithi053.stdout:Waiting for mgr epoch 9... 2024-09-15T03:17:00.940 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:00 smithi053 bash[15335]: debug 2024-09-15T03:17:00.544+0000 7f9a82356ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T03:17:00.940 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:00 smithi053 bash[15335]: debug 2024-09-15T03:17:00.688+0000 7f9a82356ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T03:17:01.430 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:01 smithi053 bash[15335]: debug 2024-09-15T03:17:01.020+0000 7f9a82356ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T03:17:01.430 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:01 smithi053 bash[15335]: debug 2024-09-15T03:17:01.252+0000 7f9a82356ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:17:02.011 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:01 smithi053 bash[15335]: debug 2024-09-15T03:17:01.704+0000 7f9a82356ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T03:17:02.012 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:01 smithi053 bash[15335]: debug 2024-09-15T03:17:01.772+0000 7f9a82356ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T03:17:02.012 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:01 smithi053 bash[15335]: debug 2024-09-15T03:17:01.840+0000 7f9a82356ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T03:17:02.012 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:01 smithi053 bash[15335]: debug 2024-09-15T03:17:01.936+0000 7f9a82356ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T03:17:02.012 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:02 smithi053 bash[15335]: debug 2024-09-15T03:17:02.004+0000 7f9a82356ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T03:17:02.332 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:02 smithi053 bash[15335]: debug 2024-09-15T03:17:02.088+0000 7f9a82356ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T03:17:02.332 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:02 smithi053 bash[15335]: debug 2024-09-15T03:17:02.244+0000 7f9a82356ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T03:17:02.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:02 smithi053 bash[15335]: debug 2024-09-15T03:17:02.324+0000 7f9a82356ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T03:17:03.652 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15335]: debug 2024-09-15T03:17:03.340+0000 7f9a82356ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: cluster 2024-09-15T03:17:03.366732+0000 mon.a (mon.0) 74 : cluster [INF] Active manager daemon y restarted 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: cluster 2024-09-15T03:17:03.367171+0000 mon.a (mon.0) 75 : cluster [INF] Activating manager daemon y 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: cluster 2024-09-15T03:17:03.373924+0000 mon.a (mon.0) 76 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: cluster 2024-09-15T03:17:03.374136+0000 mon.a (mon.0) 77 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0071371s) 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: audit 2024-09-15T03:17:03.375594+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: audit 2024-09-15T03:17:03.376938+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: audit 2024-09-15T03:17:03.377941+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: audit 2024-09-15T03:17:03.378159+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: audit 2024-09-15T03:17:03.378353+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T03:17:03.653 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:03 smithi053 bash[15077]: cluster 2024-09-15T03:17:03.408944+0000 mon.a (mon.0) 83 : cluster [INF] Manager daemon y is now available 2024-09-15T03:17:04.689 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:04 smithi053 bash[15077]: audit 2024-09-15T03:17:03.431448+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:04 smithi053 bash[15077]: audit 2024-09-15T03:17:03.435984+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:04 smithi053 bash[15077]: audit 2024-09-15T03:17:03.466721+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-15T03:17:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:04 smithi053 bash[15077]: audit 2024-09-15T03:17:03.471393+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-15T03:17:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:04 smithi053 bash[15077]: cluster 2024-09-15T03:17:04.375448+0000 mon.a (mon.0) 88 : cluster [DBG] mgrmap e11: y(active, since 1.00846s) 2024-09-15T03:17:05.042 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout { 2024-09-15T03:17:05.042 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T03:17:05.042 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T03:17:05.042 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout } 2024-09-15T03:17:05.042 INFO:teuthology.orchestra.run.smithi053.stdout:mgr epoch 9 is available 2024-09-15T03:17:05.042 INFO:teuthology.orchestra.run.smithi053.stdout:Generating a dashboard self-signed certificate... 2024-09-15T03:17:05.431 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: debug 2024-09-15T03:17:05.360+0000 7f9a32ea7640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:03:17:05] ENGINE Error in HTTPServer.serve 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: Traceback (most recent call last): 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: self._connections.run(self.expiration_interval) 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: self._run(expiration_interval) 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:17:05.432 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: s = self.context.wrap_socket( 2024-09-15T03:17:05.433 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:17:05.433 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: return self.sslsocket_class._create( 2024-09-15T03:17:05.433 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:17:05.433 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: self.do_handshake() 2024-09-15T03:17:05.433 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:17:05.433 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: self._sslobj.do_handshake() 2024-09-15T03:17:05.433 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15335]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:17:05.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15077]: audit 2024-09-15T03:17:04.378619+0000 mgr.y (mgr.14150) 1 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T03:17:05.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15077]: audit 2024-09-15T03:17:04.389789+0000 mgr.y (mgr.14150) 2 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T03:17:05.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:05 smithi053 bash[15077]: audit 2024-09-15T03:17:05.365765+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:06.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: cephadm 2024-09-15T03:17:05.230570+0000 mgr.y (mgr.14150) 3 : cephadm [INF] [15/Sep/2024:03:17:05] ENGINE Bus STARTING 2024-09-15T03:17:06.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: cephadm 2024-09-15T03:17:05.360718+0000 mgr.y (mgr.14150) 4 : cephadm [INF] [15/Sep/2024:03:17:05] ENGINE Serving on https://172.21.15.53:7150 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: cephadm 2024-09-15T03:17:05.360853+0000 mgr.y (mgr.14150) 5 : cephadm [INF] [15/Sep/2024:03:17:05] ENGINE Bus STARTED 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: cephadm 2024-09-15T03:17:05.364571+0000 mgr.y (mgr.14150) 6 : cephadm [ERR] [15/Sep/2024:03:17:05] ENGINE Error in HTTPServer.serve 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: Traceback (most recent call last): 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: self._connections.run(self.expiration_interval) 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: self._run(expiration_interval) 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:17:06.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: s = self.context.wrap_socket( 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: return self.sslsocket_class._create( 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: self.do_handshake() 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: self._sslobj.do_handshake() 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:17:06.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:06 smithi053 bash[15077]: cluster 2024-09-15T03:17:06.370318+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e12: y(active, since 3s) 2024-09-15T03:17:07.110 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T03:17:07.110 INFO:teuthology.orchestra.run.smithi053.stdout:Creating initial admin user... 2024-09-15T03:17:07.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:07 smithi053 bash[15077]: audit 2024-09-15T03:17:06.422479+0000 mgr.y (mgr.14150) 7 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:17:07.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:07 smithi053 bash[15077]: audit 2024-09-15T03:17:06.497011+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:07.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:07 smithi053 bash[15077]: audit 2024-09-15T03:17:06.501027+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:09.156 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:08 smithi053 bash[15077]: audit 2024-09-15T03:17:08.672815+0000 mgr.y (mgr.14150) 8 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:17:09.531 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$PYDveVGD6BbUdFbbO1RJZeEnZv2Is6TL2nB8yJup8JdpIdTUSyhR.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726370228, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T03:17:09.531 INFO:teuthology.orchestra.run.smithi053.stdout:Fetching dashboard port number... 2024-09-15T03:17:09.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:09 smithi053 bash[15077]: audit 2024-09-15T03:17:08.805446+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:09.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:09 smithi053 bash[15077]: audit 2024-09-15T03:17:08.810019+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:17:09.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:09 smithi053 bash[15077]: audit 2024-09-15T03:17:08.815352+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:09.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:09 smithi053 bash[15077]: audit 2024-09-15T03:17:08.817316+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi053", "caps": []}]: dispatch 2024-09-15T03:17:09.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:09 smithi053 bash[15077]: audit 2024-09-15T03:17:08.933611+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:11.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:10 smithi053 bash[15077]: cephadm 2024-09-15T03:17:09.865044+0000 mgr.y (mgr.14150) 9 : cephadm [INF] Deploying daemon agent.smithi053 on smithi053 2024-09-15T03:17:11.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:10 smithi053 bash[15077]: cluster 2024-09-15T03:17:09.936741+0000 mon.a (mon.0) 98 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-09-15T03:17:11.774 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T03:17:11.774 INFO:teuthology.orchestra.run.smithi053.stdout:firewalld does not appear to be present 2024-09-15T03:17:11.774 INFO:teuthology.orchestra.run.smithi053.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T03:17:11.778 INFO:teuthology.orchestra.run.smithi053.stdout:Ceph Dashboard is now available at: 2024-09-15T03:17:11.778 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:11.778 INFO:teuthology.orchestra.run.smithi053.stdout: URL: https://smithi053.front.sepia.ceph.com:8443/ 2024-09-15T03:17:11.778 INFO:teuthology.orchestra.run.smithi053.stdout: User: admin 2024-09-15T03:17:11.778 INFO:teuthology.orchestra.run.smithi053.stdout: Password: qre31rlk51 2024-09-15T03:17:11.779 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:11.779 INFO:teuthology.orchestra.run.smithi053.stdout:Saving cluster configuration to /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config directory 2024-09-15T03:17:11.779 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling autotune for osd_memory_target 2024-09-15T03:17:12.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:11 smithi053 bash[15077]: audit 2024-09-15T03:17:11.144516+0000 mon.a (mon.0) 99 : audit [DBG] from='client.? 172.21.15.53:0/3835904725' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T03:17:15.966 INFO:teuthology.orchestra.run.smithi053.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T03:17:15.966 INFO:teuthology.orchestra.run.smithi053.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T03:17:15.966 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.966 INFO:teuthology.orchestra.run.smithi053.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T03:17:15.966 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.966 INFO:teuthology.orchestra.run.smithi053.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T03:17:15.966 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: ceph telemetry on 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout:For more information see: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:15.967 INFO:teuthology.orchestra.run.smithi053.stdout:Bootstrap complete. 2024-09-15T03:17:16.005 INFO:tasks.cephadm:Fetching config... 2024-09-15T03:17:16.006 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:17:16.006 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T03:17:16.010 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T03:17:16.011 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:17:16.011 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T03:17:16.059 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T03:17:16.059 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:17:16.060 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T03:17:16.113 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T03:17:16.113 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:17:16.113 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T03:17:16.167 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T03:17:16.167 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2aX2hATuzDig8oOIffTEgMhPMWmkYmbp+fSplT1QXKUXa1Ejv/tj6AB0qQWfU490sFofho6oWGWg0/gLpmgkL07AHpXYXe1sLcUzg/ow5jfUP3gbk3/3X4KyXfRLwvpjrNIzyY+DC6y8MgsjXGUXcCdj1c+7p5kTJElBJCWs3qFDqINIF0+C3wwadv01Pb/zEEdj1C06MxRivxT/p9RXoQw+yxiVD1NLOxIpzGY40V63PuNVSUIdGym6HE07Pqs43uptAzO5sdsHMu3rUT2EHrmrPlUiZ4bPkAJdxIUQqyWDj46yW7Wzl+Kory5A3UXx+GW9laioQCCM/DFxpOrqGPbSAy4S1PCdUWsu1tTUBYfjHCMPjlOWjL9F4iXDCl7OjmzsrblXwppPjqzdmAO3x0a3A18aDbv22FiWwENBM8G21MW01M117EPn82+P4UKSb9aIYp/zgH5aSn+l9h8CU3MwfRPKb6n9NdxyRiOoNRvzj+4MExcanuFfuxPRn4lk= ceph-aed93852-7310-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T03:17:16.230 INFO:teuthology.orchestra.run.smithi053.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2aX2hATuzDig8oOIffTEgMhPMWmkYmbp+fSplT1QXKUXa1Ejv/tj6AB0qQWfU490sFofho6oWGWg0/gLpmgkL07AHpXYXe1sLcUzg/ow5jfUP3gbk3/3X4KyXfRLwvpjrNIzyY+DC6y8MgsjXGUXcCdj1c+7p5kTJElBJCWs3qFDqINIF0+C3wwadv01Pb/zEEdj1C06MxRivxT/p9RXoQw+yxiVD1NLOxIpzGY40V63PuNVSUIdGym6HE07Pqs43uptAzO5sdsHMu3rUT2EHrmrPlUiZ4bPkAJdxIUQqyWDj46yW7Wzl+Kory5A3UXx+GW9laioQCCM/DFxpOrqGPbSAy4S1PCdUWsu1tTUBYfjHCMPjlOWjL9F4iXDCl7OjmzsrblXwppPjqzdmAO3x0a3A18aDbv22FiWwENBM8G21MW01M117EPn82+P4UKSb9aIYp/zgH5aSn+l9h8CU3MwfRPKb6n9NdxyRiOoNRvzj+4MExcanuFfuxPRn4lk= ceph-aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:17:16.238 DEBUG:teuthology.orchestra.run.smithi104:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2aX2hATuzDig8oOIffTEgMhPMWmkYmbp+fSplT1QXKUXa1Ejv/tj6AB0qQWfU490sFofho6oWGWg0/gLpmgkL07AHpXYXe1sLcUzg/ow5jfUP3gbk3/3X4KyXfRLwvpjrNIzyY+DC6y8MgsjXGUXcCdj1c+7p5kTJElBJCWs3qFDqINIF0+C3wwadv01Pb/zEEdj1C06MxRivxT/p9RXoQw+yxiVD1NLOxIpzGY40V63PuNVSUIdGym6HE07Pqs43uptAzO5sdsHMu3rUT2EHrmrPlUiZ4bPkAJdxIUQqyWDj46yW7Wzl+Kory5A3UXx+GW9laioQCCM/DFxpOrqGPbSAy4S1PCdUWsu1tTUBYfjHCMPjlOWjL9F4iXDCl7OjmzsrblXwppPjqzdmAO3x0a3A18aDbv22FiWwENBM8G21MW01M117EPn82+P4UKSb9aIYp/zgH5aSn+l9h8CU3MwfRPKb6n9NdxyRiOoNRvzj+4MExcanuFfuxPRn4lk= ceph-aed93852-7310-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T03:17:16.262 INFO:teuthology.orchestra.run.smithi104.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2aX2hATuzDig8oOIffTEgMhPMWmkYmbp+fSplT1QXKUXa1Ejv/tj6AB0qQWfU490sFofho6oWGWg0/gLpmgkL07AHpXYXe1sLcUzg/ow5jfUP3gbk3/3X4KyXfRLwvpjrNIzyY+DC6y8MgsjXGUXcCdj1c+7p5kTJElBJCWs3qFDqINIF0+C3wwadv01Pb/zEEdj1C06MxRivxT/p9RXoQw+yxiVD1NLOxIpzGY40V63PuNVSUIdGym6HE07Pqs43uptAzO5sdsHMu3rUT2EHrmrPlUiZ4bPkAJdxIUQqyWDj46yW7Wzl+Kory5A3UXx+GW9laioQCCM/DFxpOrqGPbSAy4S1PCdUWsu1tTUBYfjHCMPjlOWjL9F4iXDCl7OjmzsrblXwppPjqzdmAO3x0a3A18aDbv22FiWwENBM8G21MW01M117EPn82+P4UKSb9aIYp/zgH5aSn+l9h8CU3MwfRPKb6n9NdxyRiOoNRvzj+4MExcanuFfuxPRn4lk= ceph-aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:17:16.273 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T03:17:16.527 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:16 smithi053 bash[15077]: audit 2024-09-15T03:17:15.415067+0000 mon.a (mon.0) 100 : audit [INF] from='client.? 172.21.15.53:0/3094489685' entity='client.admin' 2024-09-15T03:17:17.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:16.529651+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:17.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:16.534387+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:17.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:16.537529+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:17.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:16.557815+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:17.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:16.564861+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:17.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:16.590392+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:17.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:16.597287+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:17.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:17 smithi053 bash[15077]: audit 2024-09-15T03:17:17.403982+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:19.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:19 smithi053 bash[15077]: audit 2024-09-15T03:17:18.460997+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:21.011 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:17:22.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:22 smithi053 bash[15077]: audit 2024-09-15T03:17:21.517098+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:22.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:22 smithi053 bash[15077]: audit 2024-09-15T03:17:21.520838+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:24.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:24 smithi053 bash[15077]: cluster 2024-09-15T03:17:23.379900+0000 mgr.y (mgr.14150) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:24.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:24 smithi053 bash[15077]: audit 2024-09-15T03:17:24.159477+0000 mon.a (mon.0) 112 : audit [INF] from='client.? 172.21.15.53:0/748295708' entity='client.admin' 2024-09-15T03:17:24.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:24 smithi053 bash[15077]: audit 2024-09-15T03:17:24.176024+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:24.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:24 smithi053 bash[15077]: audit 2024-09-15T03:17:24.182493+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:24.768 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T03:17:24.768 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T03:17:26.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:26 smithi053 bash[15077]: cluster 2024-09-15T03:17:25.380415+0000 mgr.y (mgr.14150) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:28.796 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:28 smithi053 bash[15077]: cluster 2024-09-15T03:17:27.380846+0000 mgr.y (mgr.14150) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:29.792 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:17:30.776 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:30 smithi053 bash[15077]: cluster 2024-09-15T03:17:29.381283+0000 mgr.y (mgr.14150) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:30.777 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:30 smithi053 bash[15077]: audit 2024-09-15T03:17:29.523924+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:30.777 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:30 smithi053 bash[15077]: audit 2024-09-15T03:17:29.529124+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:32.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:32 smithi053 bash[15077]: cluster 2024-09-15T03:17:31.381668+0000 mgr.y (mgr.14150) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:33.570 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi104 2024-09-15T03:17:33.571 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:17:33.571 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/etc/ceph/ceph.conf 2024-09-15T03:17:33.579 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:17:33.579 DEBUG:teuthology.orchestra.run.smithi104:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:17:33.627 INFO:tasks.cephadm:Adding host smithi104 to orchestrator... 2024-09-15T03:17:33.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch host add smithi104 2024-09-15T03:17:34.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:32.952761+0000 mgr.y (mgr.14150) 15 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:17:34.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:32.957447+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:34.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:32.958683+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:32.962011+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:32.962998+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: cephadm 2024-09-15T03:17:32.964329+0000 mgr.y (mgr.14150) 16 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: cephadm 2024-09-15T03:17:33.088006+0000 mgr.y (mgr.14150) 17 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: cephadm 2024-09-15T03:17:33.204193+0000 mgr.y (mgr.14150) 18 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: cephadm 2024-09-15T03:17:33.316633+0000 mgr.y (mgr.14150) 19 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: cluster 2024-09-15T03:17:33.381983+0000 mgr.y (mgr.14150) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:33.450606+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:33.454161+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:33 smithi053 bash[15077]: audit 2024-09-15T03:17:33.457602+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:36.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:36 smithi053 bash[15077]: cluster 2024-09-15T03:17:35.382396+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:38.361 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:17:38.687 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:38 smithi053 bash[15077]: cluster 2024-09-15T03:17:37.382805+0000 mgr.y (mgr.14150) 22 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:40.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:40 smithi053 bash[15077]: cluster 2024-09-15T03:17:39.383125+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:40.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:40 smithi053 bash[15077]: audit 2024-09-15T03:17:40.255741+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:40.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:40 smithi053 bash[15077]: audit 2024-09-15T03:17:40.258851+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:40.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:40 smithi053 bash[15077]: audit 2024-09-15T03:17:40.264361+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:42.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:42 smithi053 bash[15077]: cluster 2024-09-15T03:17:41.383419+0000 mgr.y (mgr.14150) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:44.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:44 smithi053 bash[15077]: audit 2024-09-15T03:17:42.951238+0000 mgr.y (mgr.14150) 25 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi104", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:17:44.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:44 smithi053 bash[15077]: cluster 2024-09-15T03:17:43.383752+0000 mgr.y (mgr.14150) 26 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:45.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:45 smithi053 bash[15077]: cephadm 2024-09-15T03:17:44.382362+0000 mgr.y (mgr.14150) 27 : cephadm [INF] Deploying cephadm binary to smithi104 2024-09-15T03:17:46.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:46 smithi053 bash[15077]: cluster 2024-09-15T03:17:45.384140+0000 mgr.y (mgr.14150) 28 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:47.294 INFO:teuthology.orchestra.run.smithi053.stdout:Added host 'smithi104' with addr '172.21.15.104' 2024-09-15T03:17:47.936 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T03:17:48.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:48 smithi053 bash[15077]: audit 2024-09-15T03:17:47.291995+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:48.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:48 smithi053 bash[15077]: cephadm 2024-09-15T03:17:47.292611+0000 mgr.y (mgr.14150) 29 : cephadm [INF] Added host smithi104 2024-09-15T03:17:48.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:48 smithi053 bash[15077]: audit 2024-09-15T03:17:47.293379+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:48.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:48 smithi053 bash[15077]: cluster 2024-09-15T03:17:47.384437+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:48.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:48 smithi053 bash[15077]: audit 2024-09-15T03:17:47.582626+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:50.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:48.870326+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:50.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:48.875688+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:50.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:48.876829+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:48.878499+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:48.879893+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: cephadm 2024-09-15T03:17:48.881918+0000 mgr.y (mgr.14150) 31 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: cephadm 2024-09-15T03:17:49.014935+0000 mgr.y (mgr.14150) 32 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: cephadm 2024-09-15T03:17:49.156994+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: cephadm 2024-09-15T03:17:49.286039+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: cluster 2024-09-15T03:17:49.384836+0000 mgr.y (mgr.14150) 35 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:49.425575+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:49.430486+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:49.432786+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi104", "caps": []}]: dispatch 2024-09-15T03:17:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:49 smithi053 bash[15077]: audit 2024-09-15T03:17:49.435155+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi104", "caps": []}]': finished 2024-09-15T03:17:51.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:50 smithi053 bash[15077]: cephadm 2024-09-15T03:17:50.225033+0000 mgr.y (mgr.14150) 36 : cephadm [INF] Deploying daemon agent.smithi104 on smithi104 2024-09-15T03:17:52.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:50.917760+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:52.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:50.923022+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:50.925989+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:50.967770+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:50.970497+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:50.971564+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:50.978150+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:51.021463+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:51.024515+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:51.025994+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:51.032714+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: audit 2024-09-15T03:17:51.265093+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:51 smithi053 bash[15077]: cluster 2024-09-15T03:17:51.385292+0000 mgr.y (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:52.658 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:17:53.658 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:53 smithi053 bash[15077]: audit 2024-09-15T03:17:52.369183+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:53.658 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:53 smithi053 bash[15077]: audit 2024-09-15T03:17:52.374607+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:54.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:54 smithi053 bash[15077]: cluster 2024-09-15T03:17:53.385636+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:54.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:54 smithi053 bash[15077]: audit 2024-09-15T03:17:53.468192+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:17:56.361 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:17:56.361 INFO:teuthology.orchestra.run.smithi053.stdout:[{"addr": "172.21.15.53", "hostname": "smithi053", "labels": [], "status": ""}, {"addr": "172.21.15.104", "hostname": "smithi104", "labels": [], "status": ""}] 2024-09-15T03:17:56.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:56 smithi053 bash[15077]: cluster 2024-09-15T03:17:55.385913+0000 mgr.y (mgr.14150) 39 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:17:57.437 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T03:17:57.437 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T03:17:57.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:57 smithi053 bash[15077]: audit 2024-09-15T03:17:56.359323+0000 mgr.y (mgr.14150) 40 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:17:58.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:17:58 smithi053 bash[15077]: cluster 2024-09-15T03:17:57.386296+0000 mgr.y (mgr.14150) 41 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:00.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:00 smithi053 bash[15077]: cluster 2024-09-15T03:17:59.386677+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:00.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:00 smithi053 bash[15077]: audit 2024-09-15T03:18:00.442928+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:00.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:00 smithi053 bash[15077]: audit 2024-09-15T03:18:00.446671+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:00.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:00 smithi053 bash[15077]: audit 2024-09-15T03:18:00.452215+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:02.927 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:18:02.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:02 smithi053 bash[15077]: cluster 2024-09-15T03:18:01.387111+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:04 smithi053 bash[15077]: cluster 2024-09-15T03:18:03.387521+0000 mgr.y (mgr.14150) 44 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:06.483 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-09-15T03:18:06.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:06 smithi053 bash[15077]: cluster 2024-09-15T03:18:05.387820+0000 mgr.y (mgr.14150) 45 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:06.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:06 smithi053 bash[15077]: audit 2024-09-15T03:18:05.424477+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:06.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:06 smithi053 bash[15077]: audit 2024-09-15T03:18:05.430900+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:06.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:06 smithi053 bash[15077]: audit 2024-09-15T03:18:06.041589+0000 mon.a (mon.0) 159 : audit [INF] from='client.? 172.21.15.53:0/2715228095' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T03:18:07.189 INFO:tasks.cephadm:Adding mon.a on smithi053 2024-09-15T03:18:07.190 INFO:tasks.cephadm:Adding mon.c on smithi053 2024-09-15T03:18:07.190 INFO:tasks.cephadm:Adding mon.b on smithi104 2024-09-15T03:18:07.190 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b' 2024-09-15T03:18:07.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:07 smithi053 bash[15077]: audit 2024-09-15T03:18:06.482042+0000 mon.a (mon.0) 160 : audit [INF] from='client.? 172.21.15.53:0/2715228095' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T03:18:07.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:07 smithi053 bash[15077]: cluster 2024-09-15T03:18:06.482131+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:08.426 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:08.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:08 smithi053 bash[15077]: cluster 2024-09-15T03:18:07.388242+0000 mgr.y (mgr.14150) 46 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:10.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:10 smithi053 bash[15077]: cluster 2024-09-15T03:18:09.388636+0000 mgr.y (mgr.14150) 47 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:11.773 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled mon update... 2024-09-15T03:18:12.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: cluster 2024-09-15T03:18:11.389025+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:12.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.760200+0000 mgr.y (mgr.14150) 49 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.770853+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.772164+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.775020+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.776438+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.782464+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.785880+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.787113+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.910785+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.921812+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:12.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:12 smithi053 bash[15077]: audit 2024-09-15T03:18:11.927758+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:13.473 DEBUG:teuthology.orchestra.run.smithi053:mon.c> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T03:18:13.476 DEBUG:teuthology.orchestra.run.smithi104:mon.b> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T03:18:13.478 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T03:18:13.479 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T03:18:13.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:13 smithi053 bash[15077]: cephadm 2024-09-15T03:18:11.765506+0000 mgr.y (mgr.14150) 50 : cephadm [INF] Saving service mon spec with placement smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b;count:3 2024-09-15T03:18:13.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:13 smithi053 bash[15077]: cephadm 2024-09-15T03:18:11.788571+0000 mgr.y (mgr.14150) 51 : cephadm [INF] Deploying daemon mon.b on smithi104 2024-09-15T03:18:14.289 INFO:journalctl@ceph.mon.c.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:18:14.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:18:14.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:14 smithi053 bash[15077]: cluster 2024-09-15T03:18:13.389413+0000 mgr.y (mgr.14150) 52 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:15.750 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:16.855 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:16 smithi053 bash[15077]: cluster 2024-09-15T03:18:15.389839+0000 mgr.y (mgr.14150) 53 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:18.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:18 smithi053 bash[15077]: cluster 2024-09-15T03:18:17.390261+0000 mgr.y (mgr.14150) 54 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:19.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:18 smithi104 systemd[1]: Started Ceph mon.b for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:18:20.230 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:19 smithi053 bash[15077]: audit 2024-09-15T03:18:18.980365+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:20.230 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:19 smithi053 bash[15077]: audit 2024-09-15T03:18:18.985160+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:20.230 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:19 smithi053 bash[15077]: audit 2024-09-15T03:18:18.988352+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:20.230 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:19 smithi053 bash[15077]: audit 2024-09-15T03:18:18.989358+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:20.230 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:19 smithi053 bash[15077]: audit 2024-09-15T03:18:18.990716+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:20.230 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:19 smithi053 bash[15077]: cephadm 2024-09-15T03:18:18.992195+0000 mgr.y (mgr.14150) 55 : cephadm [INF] Deploying daemon mon.c on smithi053 2024-09-15T03:18:20.230 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:19 smithi053 bash[15077]: cluster 2024-09-15T03:18:19.390668+0000 mgr.y (mgr.14150) 56 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:20.681 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-15T03:18:20.681 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":1,"fsid":"aed93852-7310-11ef-bceb-c7b262605968","modified":"2024-09-15T03:15:57.975029Z","created":"2024-09-15T03:15:57.975029Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T03:18:20.682 INFO:teuthology.orchestra.run.smithi104.stderr:dumped monmap epoch 1 2024-09-15T03:18:21.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.439+0000 7f606fe2a900 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-15T03:18:21.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.439+0000 7f606fe2a900 0 ceph version 17.2.7-1643-gd75f2382 (d75f23820806da622f561ee5ee7551015285993f) quincy (stable), process ceph-mon, pid 7 2024-09-15T03:18:21.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.439+0000 7f606fe2a900 0 pidfile_write: ignore empty --pid-file 2024-09-15T03:18:21.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 0 load: jerasure load: lrc 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: RocksDB version: 6.15.5 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Compile date Sep 14 2024 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: DB SUMMARY 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: DB Session ID: F68SORBJ4TWK12IYT47T 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: CURRENT file: CURRENT 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: IDENTITY file: IDENTITY 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 511 ; 2024-09-15T03:18:21.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.error_if_exists: 0 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.create_if_missing: 0 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.paranoid_checks: 1 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.env: 0x556bf2ba1440 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.fs: Posix File System 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.info_log: 0x556bf3722ee0 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.statistics: (nil) 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.use_fsync: 0 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_log_file_size: 0 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T03:18:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.allow_fallocate: 1 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.use_direct_reads: 0 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.create_missing_column_families: 0 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.db_log_dir: 2024-09-15T03:18:21.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.advise_random_on_open: 1 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.write_buffer_manager: 0x556bf37e07e0 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T03:18:21.738 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.rate_limiter: (nil) 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.unordered_write: 0 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.row_cache: None 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.wal_filter: None 2024-09-15T03:18:21.739 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.preserve_deletes: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.two_write_queues: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.manual_wal_flush: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.atomic_flush: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.log_readahead_size: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T03:18:21.740 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_background_jobs: 2 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_background_compactions: -1 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_subcompactions: 1 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_total_wal_size: 0 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T03:18:21.741 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_open_files: -1 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bytes_per_sync: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_background_flushes: -1 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Compression algorithms supported: 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kZSTD supported: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kXpressCompression supported: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kBZip2Compression supported: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T03:18:21.742 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kLZ4Compression supported: 1 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kZlibCompression supported: 1 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: kSnappyCompression supported: 1 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.merge_operator: 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_filter: None 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_filter_factory: None 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T03:18:21.743 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556bf36cba38) 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cache_index_and_filter_blocks: 1 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: pin_top_level_index_and_filter: 1 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: index_type: 0 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: data_block_index_type: 0 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: index_shortening: 1 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: data_block_hash_table_util_ratio: 0.750000 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: hash_index_allow_collision: 1 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: checksum: 1 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: no_block_cache: 0 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_cache: 0x556bf36ff1f0 2024-09-15T03:18:21.744 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_cache_name: BinnedLRUCache 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_cache_options: 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: capacity : 536870912 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: num_shard_bits : 4 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: strict_capacity_limit : 0 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: high_pri_pool_ratio: 0.000 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_cache_compressed: (nil) 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: persistent_cache: (nil) 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_size: 4096 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_size_deviation: 10 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_restart_interval: 16 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: index_block_restart_interval: 1 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: metadata_block_size: 4096 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: partition_filters: 0 2024-09-15T03:18:21.745 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: use_delta_encoding: 1 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: whole_key_filtering: 1 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: verify_compression: 0 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: read_amp_bytes_per_bit: 0 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: format_version: 4 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: enable_index_compression: 1 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: block_align: 0 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression: NoCompression 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T03:18:21.746 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.num_levels: 7 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression_opts.level: 32767 2024-09-15T03:18:21.747 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compression_opts.enabled: false 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T03:18:21.748 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.arena_block_size: 4194304 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-15T03:18:21.749 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.inplace_update_support: 0 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T03:18:21.750 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.bloom_locality: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.max_successive_merges: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.force_consistency_checks: 1 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.ttl: 2592000 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T03:18:21.751 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.enable_blob_files: false 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.min_blob_size: 0 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.blob_file_size: 268435456 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.443+0000 7f606fe2a900 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370301448989, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 3 rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370301449492, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1571, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726370301, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "8777b6cb-318d-43b9-ae98-35fd1e051f82", "db_session_id": "F68SORBJ4TWK12IYT47T"}} 2024-09-15T03:18:21.752 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370301450032, "job": 1, "event": "recovery_finished"} 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x556bf3734700 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 4 rocksdb: DB pointer 0x556bf3702000 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f6065bf6640 4 rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f6065bf6640 4 rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ** DB Stats ** 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T03:18:21.753 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-15T03:18:21.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:18:21.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ** Compaction Stats [default] ** 2024-09-15T03:18:21.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:21.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:21.754 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2024-09-15T03:18:21.755 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2024-09-15T03:18:21.755 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2024-09-15T03:18:21.755 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ** Compaction Stats [default] ** 2024-09-15T03:18:21.755 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:21.755 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Cumulative compaction: 0.00 GB write, 0.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Interval compaction: 0.00 GB write, 0.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ** Compaction Stats [default] ** 2024-09-15T03:18:21.756 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ** Compaction Stats [default] ** 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.000 0 0 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:18:21.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Cumulative compaction: 0.00 GB write, 0.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.447+0000 7f606fe2a900 0 using public_addr v2:172.21.15.104:0/0 -> [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.451+0000 7f606fe2a900 0 starting mon.b rank -1 at public addrs [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] at bind addrs [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.451+0000 7f606fe2a900 1 mon.b@-1(???) e0 preinit fsid aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 0 mon.b@-1(synchronizing).mds e1 new map 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 0 mon.b@-1(synchronizing).mds e1 print_map 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: e1 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-15T03:18:21.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: legacy client fscid: -1 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: No filesystems configured 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.475+0000 7f6068bfc640 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:18:21.759 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:27.380846+0000 mgr.y (mgr.14150) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:29.381283+0000 mgr.y (mgr.14150) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:29.523924+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:29.529124+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:31.381668+0000 mgr.y (mgr.14150) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:32.952761+0000 mgr.y (mgr.14150) 15 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:32.957447+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:32.958683+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:32.962011+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:32.962998+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:32.964329+0000 mgr.y (mgr.14150) 16 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:33.088006+0000 mgr.y (mgr.14150) 17 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:33.204193+0000 mgr.y (mgr.14150) 18 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:33.316633+0000 mgr.y (mgr.14150) 19 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:18:21.760 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:33.381983+0000 mgr.y (mgr.14150) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:33.450606+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:33.454161+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:33.457602+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:35.382396+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:37.382805+0000 mgr.y (mgr.14150) 22 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:39.383125+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:40.255741+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:40.258851+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:40.264361+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:41.383419+0000 mgr.y (mgr.14150) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:42.951238+0000 mgr.y (mgr.14150) 25 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi104", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:43.383752+0000 mgr.y (mgr.14150) 26 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:44.382362+0000 mgr.y (mgr.14150) 27 : cephadm [INF] Deploying cephadm binary to smithi104 2024-09-15T03:18:21.761 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:45.384140+0000 mgr.y (mgr.14150) 28 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:47.291995+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:47.292611+0000 mgr.y (mgr.14150) 29 : cephadm [INF] Added host smithi104 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:47.293379+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:47.384437+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:47.582626+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:48.870326+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:48.875688+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:48.876829+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:48.878499+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:48.879893+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:48.881918+0000 mgr.y (mgr.14150) 31 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:49.014935+0000 mgr.y (mgr.14150) 32 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:49.156994+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:18:21.762 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:49.286039+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:49.384836+0000 mgr.y (mgr.14150) 35 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:49.425575+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:49.430486+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:49.432786+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi104", "caps": []}]: dispatch 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:49.435155+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi104", "caps": []}]': finished 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:17:50.225033+0000 mgr.y (mgr.14150) 36 : cephadm [INF] Deploying daemon agent.smithi104 on smithi104 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:50.917760+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:50.923022+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.763 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:50.925989+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:50.967770+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:50.970497+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:50.971564+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:50.978150+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:51.021463+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:51.024515+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:51.025994+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:51.032714+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:51.265093+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:51.385292+0000 mgr.y (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:52.369183+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:52.374607+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:53.385636+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.764 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:53.468192+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:55.385913+0000 mgr.y (mgr.14150) 39 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:17:56.359323+0000 mgr.y (mgr.14150) 40 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:57.386296+0000 mgr.y (mgr.14150) 41 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:17:59.386677+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:00.442928+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:00.446671+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:00.452215+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:01.387111+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:03.387521+0000 mgr.y (mgr.14150) 44 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:05.387820+0000 mgr.y (mgr.14150) 45 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:05.424477+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.765 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:05.430900+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:06.041589+0000 mon.a (mon.0) 159 : audit [INF] from='client.? 172.21.15.53:0/2715228095' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:06.482042+0000 mon.a (mon.0) 160 : audit [INF] from='client.? 172.21.15.53:0/2715228095' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:06.482131+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:07.388242+0000 mgr.y (mgr.14150) 46 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:09.388636+0000 mgr.y (mgr.14150) 47 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:11.389025+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.760200+0000 mgr.y (mgr.14150) 49 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.770853+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.772164+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.775020+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.776438+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.782464+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.766 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.785880+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.787113+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.910785+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.921812+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:11.927758+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:18:11.765506+0000 mgr.y (mgr.14150) 50 : cephadm [INF] Saving service mon spec with placement smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b;count:3 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:18:11.788571+0000 mgr.y (mgr.14150) 51 : cephadm [INF] Deploying daemon mon.b on smithi104 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:13.389413+0000 mgr.y (mgr.14150) 52 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:15.389839+0000 mgr.y (mgr.14150) 53 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:17.390261+0000 mgr.y (mgr.14150) 54 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:18.980365+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:18.985160+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:18.988352+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:21.767 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:18.989358+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:21.768 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: audit 2024-09-15T03:18:18.990716+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:21.768 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cephadm 2024-09-15T03:18:18.992195+0000 mgr.y (mgr.14150) 55 : cephadm [INF] Deploying daemon mon.c on smithi053 2024-09-15T03:18:21.768 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: cluster 2024-09-15T03:18:19.390668+0000 mgr.y (mgr.14150) 56 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:21.768 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:21 smithi104 bash[15781]: debug 2024-09-15T03:18:21.479+0000 7f6068bfc640 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-09-15T03:18:22.636 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T03:18:22.636 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T03:18:23.339 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:23 smithi053 systemd[1]: Started Ceph mon.c for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:18:24.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.330+0000 7fe965005900 0 set uid:gid to 167:167 (ceph:ceph) 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.330+0000 7fe965005900 0 ceph version 17.2.7-1643-gd75f2382 (d75f23820806da622f561ee5ee7551015285993f) quincy (stable), process ceph-mon, pid 7 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.330+0000 7fe965005900 0 pidfile_write: ignore empty --pid-file 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 0 load: jerasure load: lrc 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: RocksDB version: 6.15.5 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Compile date Sep 14 2024 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: DB SUMMARY 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: DB Session ID: ZX92HZZODOLJ91X1FUML 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: CURRENT file: CURRENT 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: IDENTITY file: IDENTITY 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-09-15T03:18:24.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.error_if_exists: 0 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.create_if_missing: 0 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.paranoid_checks: 1 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.env: 0x55a2f7f81440 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.fs: Posix File System 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.info_log: 0x55a2f8cbaee0 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_file_opening_threads: 16 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.statistics: (nil) 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.use_fsync: 0 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_log_file_size: 0 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T03:18:24.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T03:18:24.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.keep_log_file_num: 1000 2024-09-15T03:18:24.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.recycle_log_file_num: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.allow_fallocate: 1 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.allow_mmap_reads: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.allow_mmap_writes: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.use_direct_reads: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.create_missing_column_families: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.db_log_dir: 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T03:18:24.694 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.advise_random_on_open: 1 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.db_write_buffer_size: 0 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.write_buffer_manager: 0x55a2f8d78810 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.rate_limiter: (nil) 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.wal_recovery_mode: 2 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.enable_thread_tracking: 0 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.enable_pipelined_write: 0 2024-09-15T03:18:24.695 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.unordered_write: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.row_cache: None 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.wal_filter: None 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.allow_ingest_behind: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.preserve_deletes: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.two_write_queues: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.manual_wal_flush: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.atomic_flush: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T03:18:24.696 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.log_readahead_size: 0 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.best_efforts_recovery: 0 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.allow_data_in_errors: 0 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.db_host_id: __hostname__ 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_background_jobs: 2 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_background_compactions: -1 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_subcompactions: 1 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T03:18:24.697 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_total_wal_size: 0 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_open_files: -1 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.bytes_per_sync: 0 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.compaction_readahead_size: 0 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Options.max_background_flushes: -1 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Compression algorithms supported: 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kZSTD supported: 0 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kXpressCompression supported: 0 2024-09-15T03:18:24.698 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kBZip2Compression supported: 0 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kLZ4Compression supported: 1 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kZlibCompression supported: 1 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kLZ4HCCompression supported: 1 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: kSnappyCompression supported: 1 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.334+0000 7fe965005900 4 rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.merge_operator: 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_filter: None 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_filter_factory: None 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.sst_partitioner_factory: None 2024-09-15T03:18:24.699 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a2f8c63a38) 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cache_index_and_filter_blocks: 1 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: pin_top_level_index_and_filter: 1 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: index_type: 0 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: data_block_index_type: 0 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: index_shortening: 1 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: data_block_hash_table_util_ratio: 0.750000 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: hash_index_allow_collision: 1 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: checksum: 1 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: no_block_cache: 0 2024-09-15T03:18:24.700 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_cache: 0x55a2f8c971f0 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_cache_name: BinnedLRUCache 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_cache_options: 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: capacity : 536870912 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: num_shard_bits : 4 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: strict_capacity_limit : 0 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: high_pri_pool_ratio: 0.000 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_cache_compressed: (nil) 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: persistent_cache: (nil) 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_size: 4096 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_size_deviation: 10 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_restart_interval: 16 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: index_block_restart_interval: 1 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: metadata_block_size: 4096 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: partition_filters: 0 2024-09-15T03:18:24.701 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: use_delta_encoding: 1 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: whole_key_filtering: 1 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: verify_compression: 0 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: read_amp_bytes_per_bit: 0 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: format_version: 4 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: enable_index_compression: 1 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: block_align: 0 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.write_buffer_size: 33554432 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_write_buffer_number: 2 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression: NoCompression 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression: Disabled 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.prefix_extractor: nullptr 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T03:18:24.702 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.num_levels: 7 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression_opts.level: 32767 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression_opts.strategy: 0 2024-09-15T03:18:24.703 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compression_opts.enabled: false 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.target_file_size_base: 67108864 2024-09-15T03:18:24.704 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T03:18:24.705 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T03:18:24.705 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T03:18:24.705 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T03:18:24.705 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T03:18:24.706 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T03:18:24.706 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T03:18:24.706 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.arena_block_size: 4194304 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.disable_auto_compactions: 0 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T03:18:24.707 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.inplace_update_support: 0 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T03:18:24.708 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.bloom_locality: 0 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.max_successive_merges: 0 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.paranoid_file_checks: 0 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.force_consistency_checks: 1 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.report_bg_io_stats: 0 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.ttl: 2592000 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.enable_blob_files: false 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.min_blob_size: 0 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.blob_file_size: 268435456 2024-09-15T03:18:24.709 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370304342229, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 3 rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370304342795, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1571, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726370304, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "5e3c29b7-3cc4-49e6-ad2b-9d7003a06dc5", "db_session_id": "ZX92HZZODOLJ91X1FUML"}} 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-09-15T03:18:24.710 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1726370304343464, "job": 1, "event": "recovery_finished"} 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.338+0000 7fe965005900 4 rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.342+0000 7fe965005900 4 rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55a2f8ccc700 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.342+0000 7fe965005900 4 rocksdb: DB pointer 0x55a2f8c9a000 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.342+0000 7fe95add1640 4 rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.342+0000 7fe95add1640 4 rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ** DB Stats ** 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ** Compaction Stats [default] ** 2024-09-15T03:18:24.711 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ** Compaction Stats [default] ** 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:18:24.712 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Interval compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ** Compaction Stats [default] ** 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ** Compaction Stats [default] ** 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-15T03:18:24.713 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: AddFile(Keys): cumulative 0, interval 0 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Cumulative compaction: 0.00 GB write, 0.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: ** File Read Latency Histogram By Level [default] ** 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.342+0000 7fe965005900 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.342+0000 7fe965005900 0 using public_addrv [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.342+0000 7fe965005900 0 starting mon.c rank -1 at public addrs [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] at bind addrs [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:18:24.714 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.346+0000 7fe965005900 1 mon.c@-1(???) e0 preinit fsid aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 0 mon.c@-1(synchronizing).mds e1 new map 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 0 mon.c@-1(synchronizing).mds e1 print_map 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: e1 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: legacy client fscid: -1 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: No filesystems configured 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T03:18:24.715 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.370+0000 7fe95ddd7640 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:27.380846+0000 mgr.y (mgr.14150) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:29.381283+0000 mgr.y (mgr.14150) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:29.523924+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:29.529124+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:31.381668+0000 mgr.y (mgr.14150) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:32.952761+0000 mgr.y (mgr.14150) 15 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:32.957447+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:32.958683+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:32.962011+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:24.716 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:32.962998+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:32.964329+0000 mgr.y (mgr.14150) 16 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:33.088006+0000 mgr.y (mgr.14150) 17 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:33.204193+0000 mgr.y (mgr.14150) 18 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:33.316633+0000 mgr.y (mgr.14150) 19 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:33.381983+0000 mgr.y (mgr.14150) 20 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:33.450606+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:33.454161+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:33.457602+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:35.382396+0000 mgr.y (mgr.14150) 21 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:37.382805+0000 mgr.y (mgr.14150) 22 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:39.383125+0000 mgr.y (mgr.14150) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:40.255741+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:40.258851+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.717 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:40.264361+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:41.383419+0000 mgr.y (mgr.14150) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:42.951238+0000 mgr.y (mgr.14150) 25 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi104", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:43.383752+0000 mgr.y (mgr.14150) 26 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:44.382362+0000 mgr.y (mgr.14150) 27 : cephadm [INF] Deploying cephadm binary to smithi104 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:45.384140+0000 mgr.y (mgr.14150) 28 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:47.291995+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:47.292611+0000 mgr.y (mgr.14150) 29 : cephadm [INF] Added host smithi104 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:47.293379+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:47.384437+0000 mgr.y (mgr.14150) 30 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:47.582626+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:48.870326+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:48.875688+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.718 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:48.876829+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:48.878499+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:48.879893+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:48.881918+0000 mgr.y (mgr.14150) 31 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:49.014935+0000 mgr.y (mgr.14150) 32 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:49.156994+0000 mgr.y (mgr.14150) 33 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:49.286039+0000 mgr.y (mgr.14150) 34 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:49.384836+0000 mgr.y (mgr.14150) 35 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:49.425575+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:49.430486+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:49.432786+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi104", "caps": []}]: dispatch 2024-09-15T03:18:24.719 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:49.435155+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi104", "caps": []}]': finished 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:17:50.225033+0000 mgr.y (mgr.14150) 36 : cephadm [INF] Deploying daemon agent.smithi104 on smithi104 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:50.917760+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:50.923022+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:50.925989+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:50.967770+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:50.970497+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:50.971564+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:50.978150+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:51.021463+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:51.024515+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:51.025994+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:51.032714+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.720 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:51.265093+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:51.385292+0000 mgr.y (mgr.14150) 37 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:52.369183+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:52.374607+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:53.385636+0000 mgr.y (mgr.14150) 38 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:53.468192+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:55.385913+0000 mgr.y (mgr.14150) 39 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:17:56.359323+0000 mgr.y (mgr.14150) 40 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:57.386296+0000 mgr.y (mgr.14150) 41 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:17:59.386677+0000 mgr.y (mgr.14150) 42 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:00.442928+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:00.446671+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:00.452215+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.721 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:01.387111+0000 mgr.y (mgr.14150) 43 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:03.387521+0000 mgr.y (mgr.14150) 44 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:05.387820+0000 mgr.y (mgr.14150) 45 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:05.424477+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:05.430900+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:06.041589+0000 mon.a (mon.0) 159 : audit [INF] from='client.? 172.21.15.53:0/2715228095' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:06.482042+0000 mon.a (mon.0) 160 : audit [INF] from='client.? 172.21.15.53:0/2715228095' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:06.482131+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:07.388242+0000 mgr.y (mgr.14150) 46 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:09.388636+0000 mgr.y (mgr.14150) 47 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:11.389025+0000 mgr.y (mgr.14150) 48 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.760200+0000 mgr.y (mgr.14150) 49 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.770853+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.772164+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:24.722 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.775020+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.776438+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.782464+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.785880+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.787113+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.910785+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.921812+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:11.927758+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:18:11.765506+0000 mgr.y (mgr.14150) 50 : cephadm [INF] Saving service mon spec with placement smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b;count:3 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:18:11.788571+0000 mgr.y (mgr.14150) 51 : cephadm [INF] Deploying daemon mon.b on smithi104 2024-09-15T03:18:24.723 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:13.389413+0000 mgr.y (mgr.14150) 52 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:15.389839+0000 mgr.y (mgr.14150) 53 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:17.390261+0000 mgr.y (mgr.14150) 54 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:18.980365+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:18.985160+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:18.988352+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:18.989358+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: audit 2024-09-15T03:18:18.990716+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cephadm 2024-09-15T03:18:18.992195+0000 mgr.y (mgr.14150) 55 : cephadm [INF] Deploying daemon mon.c on smithi053 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: cluster 2024-09-15T03:18:19.390668+0000 mgr.y (mgr.14150) 56 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:24.724 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:24 smithi053 bash[21662]: debug 2024-09-15T03:18:24.374+0000 7fe95ddd7640 1 mon.c@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-09-15T03:18:26.352 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:18:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:21.391105+0000 mgr.y (mgr.14150) 57 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:21.494061+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:18:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:21.494404+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-15T03:18:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:21.495911+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:22.488495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:23.391536+0000 mgr.y (mgr.14150) 58 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:23.488571+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:23.489618+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:24.385216+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:24.489130+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:25.385794+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:25.391953+0000 mgr.y (mgr.14150) 59 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:25.489220+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:26.385953+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:26.489155+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:26.519070+0000 mon.a (mon.0) 193 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:26.524874+0000 mon.a (mon.0) 194 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],b=[v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:18:26.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:26.545307+0000 mon.a (mon.0) 195 : cluster [DBG] fsmap 2024-09-15T03:18:26.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:26.545363+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:26.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:26.545635+0000 mon.a (mon.0) 197 : cluster [DBG] mgrmap e13: y(active, since 83s) 2024-09-15T03:18:26.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: cluster 2024-09-15T03:18:26.545879+0000 mon.a (mon.0) 198 : cluster [INF] overall HEALTH_OK 2024-09-15T03:18:26.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:26.551961+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:26.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:26.558444+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:26.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:26.564131+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:26.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:26 smithi104 bash[15781]: audit 2024-09-15T03:18:26.569543+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:26.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:21.391105+0000 mgr.y (mgr.14150) 57 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:26.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:21.494061+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:18:26.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:21.494404+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-15T03:18:26.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:21.495911+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:22.488495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:23.391536+0000 mgr.y (mgr.14150) 58 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:23.488571+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:23.489618+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:24.385216+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:24.489130+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:25.385794+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:25.391953+0000 mgr.y (mgr.14150) 59 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:25.489220+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:26.385953+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:26.489155+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:26.519070+0000 mon.a (mon.0) 193 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:26.524874+0000 mon.a (mon.0) 194 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],b=[v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:26.545307+0000 mon.a (mon.0) 195 : cluster [DBG] fsmap 2024-09-15T03:18:26.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:26.545363+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:26.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:26.545635+0000 mon.a (mon.0) 197 : cluster [DBG] mgrmap e13: y(active, since 83s) 2024-09-15T03:18:26.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: cluster 2024-09-15T03:18:26.545879+0000 mon.a (mon.0) 198 : cluster [INF] overall HEALTH_OK 2024-09-15T03:18:26.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:26.551961+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:26.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:26.558444+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:26.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:26.564131+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:26.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:26 smithi053 bash[15077]: audit 2024-09-15T03:18:26.569543+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.613695+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.616691+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.618174+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: cephadm 2024-09-15T03:18:26.619944+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: cephadm 2024-09-15T03:18:26.620173+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.908043+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.912084+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.915930+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.921564+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.937 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.926028+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.938 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.968592+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:27.938 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.969960+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:27.938 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:26.970890+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:27.938 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:27.385176+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:27.938 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:27 smithi104 bash[15781]: audit 2024-09-15T03:18:27.489231+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.613695+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.616691+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.618174+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: cephadm 2024-09-15T03:18:26.619944+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: cephadm 2024-09-15T03:18:26.620173+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.908043+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.912084+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.915930+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.921564+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.926028+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.968592+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.969960+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:26.970890+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:27.385176+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:27 smithi053 bash[15077]: audit 2024-09-15T03:18:27.489231+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:21.391105+0000 mgr.y (mgr.14150) 57 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:21.494061+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:21.494404+0000 mon.a (mon.0) 183 : cluster [INF] mon.a calling monitor election 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:21.495911+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:22.488495+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:23.391536+0000 mgr.y (mgr.14150) 58 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:23.488571+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:28.556 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:23.489618+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:24.385216+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:24.489130+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:25.385794+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:25.391953+0000 mgr.y (mgr.14150) 59 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:25.489220+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.385953+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.489155+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:26.519070+0000 mon.a (mon.0) 193 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:26.524874+0000 mon.a (mon.0) 194 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],b=[v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:26.545307+0000 mon.a (mon.0) 195 : cluster [DBG] fsmap 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:26.545363+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:26.545635+0000 mon.a (mon.0) 197 : cluster [DBG] mgrmap e13: y(active, since 83s) 2024-09-15T03:18:28.557 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cluster 2024-09-15T03:18:26.545879+0000 mon.a (mon.0) 198 : cluster [INF] overall HEALTH_OK 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.551961+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.558444+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.564131+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.569543+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.613695+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.616691+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.618174+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cephadm 2024-09-15T03:18:26.619944+0000 mgr.y (mgr.14150) 60 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: cephadm 2024-09-15T03:18:26.620173+0000 mgr.y (mgr.14150) 61 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.908043+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.912084+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.915930+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.558 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.921564+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.559 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.926028+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:28.559 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.968592+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:28.559 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.969960+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:28.559 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:26.970890+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:28.559 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:27.385176+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:28.559 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:28 smithi053 bash[21662]: audit 2024-09-15T03:18:27.489231+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:33.813 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:28.397198+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:28.397319+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:28.397422+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:28.397513+0000 mon.a (mon.0) 220 : cluster [INF] mon.a calling monitor election 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:28.405113+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:29.386289+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:29.392477+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:30.386378+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:30.394983+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:31.386771+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.814 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:31.392834+0000 mgr.y (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:32.386622+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.387085+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:33.442684+0000 mon.a (mon.0) 226 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:33.448634+0000 mon.a (mon.0) 227 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],b=[v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0],c=[v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:33.469313+0000 mon.a (mon.0) 228 : cluster [DBG] fsmap 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:33.469363+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:33.469633+0000 mon.a (mon.0) 230 : cluster [DBG] mgrmap e13: y(active, since 90s) 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: cluster 2024-09-15T03:18:33.469873+0000 mon.a (mon.0) 231 : cluster [INF] overall HEALTH_OK 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.476756+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.481251+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.486123+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.489435+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.493399+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.815 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.495208+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.496418+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[15077]: audit 2024-09-15T03:18:33.497553+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:28.397198+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:28.397319+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:28.397422+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:28.397513+0000 mon.a (mon.0) 220 : cluster [INF] mon.a calling monitor election 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:28.405113+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-15T03:18:33.816 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:29.386289+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:29.392477+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:30.386378+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:30.394983+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:31.386771+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:31.392834+0000 mgr.y (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:32.386622+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.387085+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:33.442684+0000 mon.a (mon.0) 226 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:33.448634+0000 mon.a (mon.0) 227 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],b=[v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0],c=[v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:18:33.817 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:33.469313+0000 mon.a (mon.0) 228 : cluster [DBG] fsmap 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:33.469363+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:33.469633+0000 mon.a (mon.0) 230 : cluster [DBG] mgrmap e13: y(active, since 90s) 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: cluster 2024-09-15T03:18:33.469873+0000 mon.a (mon.0) 231 : cluster [INF] overall HEALTH_OK 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.476756+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.481251+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.486123+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.489435+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.493399+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.495208+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.496418+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:33.818 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:33 smithi053 bash[21662]: audit 2024-09-15T03:18:33.497553+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:28.397198+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:18:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:28.397319+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:18:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:28.397422+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:28.397513+0000 mon.a (mon.0) 220 : cluster [INF] mon.a calling monitor election 2024-09-15T03:18:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:28.405113+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2024-09-15T03:18:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:29.386289+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:29.392477+0000 mgr.y (mgr.14150) 68 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:30.386378+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:30.394983+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:31.386771+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:31.392834+0000 mgr.y (mgr.14150) 69 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:32.386622+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.387085+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:33.442684+0000 mon.a (mon.0) 226 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:33.448634+0000 mon.a (mon.0) 227 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],b=[v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0],c=[v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:33.469313+0000 mon.a (mon.0) 228 : cluster [DBG] fsmap 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:33.469363+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:33.469633+0000 mon.a (mon.0) 230 : cluster [DBG] mgrmap e13: y(active, since 90s) 2024-09-15T03:18:33.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: cluster 2024-09-15T03:18:33.469873+0000 mon.a (mon.0) 231 : cluster [INF] overall HEALTH_OK 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.476756+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.481251+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.486123+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.489435+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.493399+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.495208+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.496418+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:33.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:33 smithi104 bash[15781]: audit 2024-09-15T03:18:33.497553+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:34.226 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-09-15T03:18:34.227 INFO:teuthology.orchestra.run.smithi104.stdout:{"epoch":3,"fsid":"aed93852-7310-11ef-bceb-c7b262605968","modified":"2024-09-15T03:18:28.393285Z","created":"2024-09-15T03:15:57.975029Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:3300","nonce":0},{"type":"v1","addr":"172.21.15.104:6789","nonce":0}]},"addr":"172.21.15.104:6789/0","public_addr":"172.21.15.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3301","nonce":0},{"type":"v1","addr":"172.21.15.53:6790","nonce":0}]},"addr":"172.21.15.53:6790/0","public_addr":"172.21.15.53:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-15T03:18:34.227 INFO:teuthology.orchestra.run.smithi104.stderr:dumped monmap epoch 3 2024-09-15T03:18:34.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: cluster 2024-09-15T03:18:33.393264+0000 mgr.y (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:34.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: cephadm 2024-09-15T03:18:33.494725+0000 mgr.y (mgr.14150) 71 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-15T03:18:34.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: cephadm 2024-09-15T03:18:33.498836+0000 mgr.y (mgr.14150) 72 : cephadm [INF] Reconfiguring daemon mon.c on smithi053 2024-09-15T03:18:34.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: audit 2024-09-15T03:18:33.688071+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: audit 2024-09-15T03:18:34.174863+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: audit 2024-09-15T03:18:34.180926+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: audit 2024-09-15T03:18:34.186088+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: audit 2024-09-15T03:18:34.225190+0000 mon.a (mon.0) 244 : audit [DBG] from='client.? 172.21.15.104:0/1645686404' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T03:18:34.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:34 smithi104 bash[15781]: audit 2024-09-15T03:18:34.386860+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: cluster 2024-09-15T03:18:33.393264+0000 mgr.y (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: cephadm 2024-09-15T03:18:33.494725+0000 mgr.y (mgr.14150) 71 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: cephadm 2024-09-15T03:18:33.498836+0000 mgr.y (mgr.14150) 72 : cephadm [INF] Reconfiguring daemon mon.c on smithi053 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: audit 2024-09-15T03:18:33.688071+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: audit 2024-09-15T03:18:34.174863+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: audit 2024-09-15T03:18:34.180926+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: audit 2024-09-15T03:18:34.186088+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: audit 2024-09-15T03:18:34.225190+0000 mon.a (mon.0) 244 : audit [DBG] from='client.? 172.21.15.104:0/1645686404' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[21662]: audit 2024-09-15T03:18:34.386860+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: cluster 2024-09-15T03:18:33.393264+0000 mgr.y (mgr.14150) 70 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: cephadm 2024-09-15T03:18:33.494725+0000 mgr.y (mgr.14150) 71 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: cephadm 2024-09-15T03:18:33.498836+0000 mgr.y (mgr.14150) 72 : cephadm [INF] Reconfiguring daemon mon.c on smithi053 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: audit 2024-09-15T03:18:33.688071+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: audit 2024-09-15T03:18:34.174863+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: audit 2024-09-15T03:18:34.180926+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: audit 2024-09-15T03:18:34.186088+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: audit 2024-09-15T03:18:34.225190+0000 mon.a (mon.0) 244 : audit [DBG] from='client.? 172.21.15.104:0/1645686404' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T03:18:34.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:34 smithi053 bash[15077]: audit 2024-09-15T03:18:34.386860+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:18:34.951 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T03:18:34.952 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T03:18:36.675 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: cluster 2024-09-15T03:18:35.393677+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: audit 2024-09-15T03:18:35.523131+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: audit 2024-09-15T03:18:35.528214+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: cephadm 2024-09-15T03:18:35.529575+0000 mgr.y (mgr.14150) 74 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: audit 2024-09-15T03:18:35.529954+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: audit 2024-09-15T03:18:35.531024+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: audit 2024-09-15T03:18:35.532047+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[15077]: cephadm 2024-09-15T03:18:35.533222+0000 mgr.y (mgr.14150) 75 : cephadm [INF] Reconfiguring daemon mon.b on smithi104 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: cluster 2024-09-15T03:18:35.393677+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: audit 2024-09-15T03:18:35.523131+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:36.676 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: audit 2024-09-15T03:18:35.528214+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:36.677 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: cephadm 2024-09-15T03:18:35.529575+0000 mgr.y (mgr.14150) 74 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-15T03:18:36.677 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: audit 2024-09-15T03:18:35.529954+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:36.677 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: audit 2024-09-15T03:18:35.531024+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:36.677 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: audit 2024-09-15T03:18:35.532047+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:36.677 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:36 smithi053 bash[21662]: cephadm 2024-09-15T03:18:35.533222+0000 mgr.y (mgr.14150) 75 : cephadm [INF] Reconfiguring daemon mon.b on smithi104 2024-09-15T03:18:36.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: cluster 2024-09-15T03:18:35.393677+0000 mgr.y (mgr.14150) 73 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:36.811 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: audit 2024-09-15T03:18:35.523131+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:36.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: audit 2024-09-15T03:18:35.528214+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:36.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: cephadm 2024-09-15T03:18:35.529575+0000 mgr.y (mgr.14150) 74 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-09-15T03:18:36.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: audit 2024-09-15T03:18:35.529954+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:36.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: audit 2024-09-15T03:18:35.531024+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:36.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: audit 2024-09-15T03:18:35.532047+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:36.812 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:36 smithi104 bash[15781]: cephadm 2024-09-15T03:18:35.533222+0000 mgr.y (mgr.14150) 75 : cephadm [INF] Reconfiguring daemon mon.b on smithi104 2024-09-15T03:18:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:36.660709+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:36.665830+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:36.672861+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:37.567334+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:37.573052+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:37.574588+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:37.577003+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[15077]: audit 2024-09-15T03:18:37.578206+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:36.660709+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:36.665830+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:36.672861+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:37.567334+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:37.573052+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:37.574588+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:37.577003+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:37.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:37 smithi053 bash[21662]: audit 2024-09-15T03:18:37.578206+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:36.660709+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:36.665830+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:36.672861+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:37.567334+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:37.573052+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:37.574588+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:37.577003+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:37.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:37 smithi104 bash[15781]: audit 2024-09-15T03:18:37.578206+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:38.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: cluster 2024-09-15T03:18:37.394197+0000 mgr.y (mgr.14150) 76 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:38.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: cephadm 2024-09-15T03:18:37.579752+0000 mgr.y (mgr.14150) 77 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:38.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: cephadm 2024-09-15T03:18:37.580055+0000 mgr.y (mgr.14150) 78 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:38.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: cephadm 2024-09-15T03:18:37.751959+0000 mgr.y (mgr.14150) 79 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:38.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: cephadm 2024-09-15T03:18:37.752259+0000 mgr.y (mgr.14150) 80 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:38.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.885084+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.889448+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.892276+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.895355+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.899139+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.941118+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.942816+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[15077]: audit 2024-09-15T03:18:37.944359+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: cluster 2024-09-15T03:18:37.394197+0000 mgr.y (mgr.14150) 76 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: cephadm 2024-09-15T03:18:37.579752+0000 mgr.y (mgr.14150) 77 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: cephadm 2024-09-15T03:18:37.580055+0000 mgr.y (mgr.14150) 78 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:38.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: cephadm 2024-09-15T03:18:37.751959+0000 mgr.y (mgr.14150) 79 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: cephadm 2024-09-15T03:18:37.752259+0000 mgr.y (mgr.14150) 80 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.885084+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.889448+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.892276+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.895355+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.899139+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.941118+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.942816+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:38.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:38 smithi053 bash[21662]: audit 2024-09-15T03:18:37.944359+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: cluster 2024-09-15T03:18:37.394197+0000 mgr.y (mgr.14150) 76 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: cephadm 2024-09-15T03:18:37.579752+0000 mgr.y (mgr.14150) 77 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: cephadm 2024-09-15T03:18:37.580055+0000 mgr.y (mgr.14150) 78 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: cephadm 2024-09-15T03:18:37.751959+0000 mgr.y (mgr.14150) 79 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: cephadm 2024-09-15T03:18:37.752259+0000 mgr.y (mgr.14150) 80 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.885084+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.889448+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.892276+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.895355+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.899139+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:38.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.941118+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T03:18:38.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.942816+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T03:18:38.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:38 smithi104 bash[15781]: audit 2024-09-15T03:18:37.944359+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:39.123 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:18:39.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:39 smithi053 bash[15077]: cephadm 2024-09-15T03:18:37.940463+0000 mgr.y (mgr.14150) 81 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-09-15T03:18:39.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:39 smithi053 bash[15077]: cephadm 2024-09-15T03:18:37.945954+0000 mgr.y (mgr.14150) 82 : cephadm [INF] Reconfiguring daemon mon.a on smithi053 2024-09-15T03:18:39.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:39 smithi053 bash[21662]: cephadm 2024-09-15T03:18:37.940463+0000 mgr.y (mgr.14150) 81 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-09-15T03:18:39.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:39 smithi053 bash[21662]: cephadm 2024-09-15T03:18:37.945954+0000 mgr.y (mgr.14150) 82 : cephadm [INF] Reconfiguring daemon mon.a on smithi053 2024-09-15T03:18:39.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:39 smithi104 bash[15781]: cephadm 2024-09-15T03:18:37.940463+0000 mgr.y (mgr.14150) 81 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-09-15T03:18:39.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:39 smithi104 bash[15781]: cephadm 2024-09-15T03:18:37.945954+0000 mgr.y (mgr.14150) 82 : cephadm [INF] Reconfiguring daemon mon.a on smithi053 2024-09-15T03:18:40.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:40 smithi053 bash[21662]: cluster 2024-09-15T03:18:39.394655+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:40.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:40 smithi053 bash[21662]: audit 2024-09-15T03:18:40.488579+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:40.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:40 smithi053 bash[21662]: audit 2024-09-15T03:18:40.494578+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:40.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:40 smithi053 bash[15077]: cluster 2024-09-15T03:18:39.394655+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:40.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:40 smithi053 bash[15077]: audit 2024-09-15T03:18:40.488579+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:40.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:40 smithi053 bash[15077]: audit 2024-09-15T03:18:40.494578+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:40 smithi104 bash[15781]: cluster 2024-09-15T03:18:39.394655+0000 mgr.y (mgr.14150) 83 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:40 smithi104 bash[15781]: audit 2024-09-15T03:18:40.488579+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:40 smithi104 bash[15781]: audit 2024-09-15T03:18:40.494578+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:42.777 INFO:teuthology.orchestra.run.smithi053.stdout:# minimal ceph.conf for aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:18:42.777 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-09-15T03:18:42.777 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = aed93852-7310-11ef-bceb-c7b262605968 2024-09-15T03:18:42.777 INFO:teuthology.orchestra.run.smithi053.stdout: mon_host = [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] [v2:172.21.15.104:3300/0,v1:172.21.15.104:6789/0] [v2:172.21.15.53:3301/0,v1:172.21.15.53:6790/0] 2024-09-15T03:18:42.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:42 smithi053 bash[15077]: cluster 2024-09-15T03:18:41.395145+0000 mgr.y (mgr.14150) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:42.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:42 smithi053 bash[21662]: cluster 2024-09-15T03:18:41.395145+0000 mgr.y (mgr.14150) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:42 smithi104 bash[15781]: cluster 2024-09-15T03:18:41.395145+0000 mgr.y (mgr.14150) 84 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:43.407 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T03:18:43.407 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:18:43.407 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T03:18:43.424 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:18:43.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:18:43.485 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:18:43.485 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T03:18:43.580 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:18:43.581 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:18:43.597 INFO:tasks.cephadm:Adding mgr.y on smithi053 2024-09-15T03:18:43.597 INFO:tasks.cephadm:Adding mgr.x on smithi104 2024-09-15T03:18:43.597 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply mgr '2;smithi053=y;smithi104=x' 2024-09-15T03:18:43.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:43 smithi104 bash[15781]: audit 2024-09-15T03:18:42.776145+0000 mon.a (mon.0) 269 : audit [DBG] from='client.? 172.21.15.53:0/539274671' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:44.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:43 smithi053 bash[15077]: audit 2024-09-15T03:18:42.776145+0000 mon.a (mon.0) 269 : audit [DBG] from='client.? 172.21.15.53:0/539274671' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:44.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:43 smithi053 bash[21662]: audit 2024-09-15T03:18:42.776145+0000 mon.a (mon.0) 269 : audit [DBG] from='client.? 172.21.15.53:0/539274671' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:44.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:44 smithi104 bash[15781]: cluster 2024-09-15T03:18:43.395528+0000 mgr.y (mgr.14150) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:45.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:44 smithi053 bash[15077]: cluster 2024-09-15T03:18:43.395528+0000 mgr.y (mgr.14150) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:45.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:44 smithi053 bash[21662]: cluster 2024-09-15T03:18:43.395528+0000 mgr.y (mgr.14150) 85 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:46.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:46 smithi104 bash[15781]: cluster 2024-09-15T03:18:45.395948+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:46 smithi053 bash[15077]: cluster 2024-09-15T03:18:45.395948+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:47.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:46 smithi053 bash[21662]: cluster 2024-09-15T03:18:45.395948+0000 mgr.y (mgr.14150) 86 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:48.331 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:18:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:48 smithi104 bash[15781]: cluster 2024-09-15T03:18:47.396393+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:49.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:48 smithi053 bash[15077]: cluster 2024-09-15T03:18:47.396393+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:49.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:48 smithi053 bash[21662]: cluster 2024-09-15T03:18:47.396393+0000 mgr.y (mgr.14150) 87 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:50.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:50 smithi053 bash[15077]: cluster 2024-09-15T03:18:49.396745+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:50 smithi053 bash[21662]: cluster 2024-09-15T03:18:49.396745+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:50 smithi104 bash[15781]: cluster 2024-09-15T03:18:49.396745+0000 mgr.y (mgr.14150) 88 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:51.719 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled mgr update... 2024-09-15T03:18:52.592 DEBUG:teuthology.orchestra.run.smithi104:mgr.x> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T03:18:52.594 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T03:18:52.594 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:18:52.594 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T03:18:52.599 DEBUG:teuthology.misc:devs=['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-09-15T03:18:52.599 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/nvme1n1 2024-09-15T03:18:52.645 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/nvme1n1 2024-09-15T03:18:52.645 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:52.645 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 526 Links: 1 Device type: 103,2 2024-09-15T03:18:52.646 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:52.646 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:17:28.635898832 +0000 2024-09-15T03:18:52.646 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:14:54.243459390 +0000 2024-09-15T03:18:52.646 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:14:54.243459390 +0000 2024-09-15T03:18:52.646 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:18:52.646 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2024-09-15T03:18:52.702 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:18:52.703 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:18:52.703 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000220446 s, 2.3 MB/s 2024-09-15T03:18:52.704 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2024-09-15T03:18:52.753 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/nvme2n1 2024-09-15T03:18:52.803 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/nvme2n1 2024-09-15T03:18:52.803 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:52.804 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 534 Links: 1 Device type: 103,4 2024-09-15T03:18:52.804 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:52.804 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:17:28.647898555 +0000 2024-09-15T03:18:52.804 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:14:54.355456807 +0000 2024-09-15T03:18:52.804 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:14:54.355456807 +0000 2024-09-15T03:18:52.804 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:18:52.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2024-09-15T03:18:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:18:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:18:52.856 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000207402 s, 2.5 MB/s 2024-09-15T03:18:52.858 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2024-09-15T03:18:52.909 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/nvme3n1 2024-09-15T03:18:52.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: cluster 2024-09-15T03:18:51.397101+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:52.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.706117+0000 mgr.y (mgr.14150) 90 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi053=y;smithi104=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:52.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: cephadm 2024-09-15T03:18:51.709559+0000 mgr.y (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi053=y;smithi104=x;count:2 2024-09-15T03:18:52.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.717414+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:52.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.718715+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:52.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.721634+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:52.952 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.722867+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.730531+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.733516+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.738119+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.739257+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: audit 2024-09-15T03:18:51.740599+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[15077]: cephadm 2024-09-15T03:18:51.741947+0000 mgr.y (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.x on smithi104 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: cluster 2024-09-15T03:18:51.397101+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.706117+0000 mgr.y (mgr.14150) 90 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi053=y;smithi104=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:52.953 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: cephadm 2024-09-15T03:18:51.709559+0000 mgr.y (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi053=y;smithi104=x;count:2 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.717414+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.718715+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.721634+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.722867+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.730531+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.733516+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.738119+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.739257+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: audit 2024-09-15T03:18:51.740599+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:52.954 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:52 smithi053 bash[21662]: cephadm 2024-09-15T03:18:51.741947+0000 mgr.y (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.x on smithi104 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/nvme3n1 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 542 Links: 1 Device type: 103,6 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:17:28.667898094 +0000 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:14:54.471454132 +0000 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:14:54.471454132 +0000 2024-09-15T03:18:52.961 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:18:52.961 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: cluster 2024-09-15T03:18:51.397101+0000 mgr.y (mgr.14150) 89 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.706117+0000 mgr.y (mgr.14150) 90 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi053=y;smithi104=x", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: cephadm 2024-09-15T03:18:51.709559+0000 mgr.y (mgr.14150) 91 : cephadm [INF] Saving service mgr spec with placement smithi053=y;smithi104=x;count:2 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.717414+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.718715+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.721634+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.722867+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.730531+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.733516+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T03:18:52.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.738119+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T03:18:52.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.739257+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T03:18:52.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: audit 2024-09-15T03:18:51.740599+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:52.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:52 smithi104 bash[15781]: cephadm 2024-09-15T03:18:51.741947+0000 mgr.y (mgr.14150) 92 : cephadm [INF] Deploying daemon mgr.x on smithi104 2024-09-15T03:18:53.020 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:18:53.020 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:18:53.020 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000369044 s, 1.4 MB/s 2024-09-15T03:18:53.020 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2024-09-15T03:18:53.077 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/nvme4n1 2024-09-15T03:18:53.127 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/nvme4n1 2024-09-15T03:18:53.127 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:53.127 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 550 Links: 1 Device type: 103,8 2024-09-15T03:18:53.127 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:53.127 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-09-15 03:17:28.683897725 +0000 2024-09-15T03:18:53.128 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-09-15 03:14:54.591451364 +0000 2024-09-15T03:18:53.128 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-09-15 03:14:54.591451364 +0000 2024-09-15T03:18:53.128 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-09-15T03:18:53.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2024-09-15T03:18:53.181 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-09-15T03:18:53.182 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-09-15T03:18:53.182 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000365247 s, 1.4 MB/s 2024-09-15T03:18:53.183 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2024-09-15T03:18:53.238 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:18:53.238 DEBUG:teuthology.orchestra.run.smithi104:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T03:18:53.243 DEBUG:teuthology.misc:devs=['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2024-09-15T03:18:53.244 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/nvme1n1 2024-09-15T03:18:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/nvme1n1 2024-09-15T03:18:53.289 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:53.290 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 526 Links: 1 Device type: 103,2 2024-09-15T03:18:53.290 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:53.290 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:18:04.507657004 +0000 2024-09-15T03:18:53.290 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:14:55.610398227 +0000 2024-09-15T03:18:53.290 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:14:55.610398227 +0000 2024-09-15T03:18:53.290 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:18:53.290 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2024-09-15T03:18:53.346 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:18:53.346 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:18:53.346 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000483914 s, 1.1 MB/s 2024-09-15T03:18:53.347 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2024-09-15T03:18:53.400 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/nvme2n1 2024-09-15T03:18:53.427 INFO:journalctl@ceph.mgr.x.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:18:53.435 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/nvme2n1 2024-09-15T03:18:53.435 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:53.435 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 534 Links: 1 Device type: 103,4 2024-09-15T03:18:53.435 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:53.435 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:18:04.523656635 +0000 2024-09-15T03:18:53.436 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:14:55.726453552 +0000 2024-09-15T03:18:53.436 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:14:55.726453552 +0000 2024-09-15T03:18:53.436 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:18:53.436 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2024-09-15T03:18:53.490 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:18:53.490 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:18:53.490 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000472005 s, 1.1 MB/s 2024-09-15T03:18:53.491 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2024-09-15T03:18:53.542 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/nvme3n1 2024-09-15T03:18:53.589 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/nvme3n1 2024-09-15T03:18:53.589 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:53.589 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 542 Links: 1 Device type: 103,6 2024-09-15T03:18:53.590 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:53.590 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:18:04.543656174 +0000 2024-09-15T03:18:53.590 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:14:55.834505062 +0000 2024-09-15T03:18:53.590 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:14:55.834505062 +0000 2024-09-15T03:18:53.590 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:18:53.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2024-09-15T03:18:53.646 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:18:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:18:53.647 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000309805 s, 1.7 MB/s 2024-09-15T03:18:53.648 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2024-09-15T03:18:53.698 DEBUG:teuthology.orchestra.run.smithi104:> stat /dev/nvme4n1 2024-09-15T03:18:53.752 INFO:teuthology.orchestra.run.smithi104.stdout: File: /dev/nvme4n1 2024-09-15T03:18:53.752 INFO:teuthology.orchestra.run.smithi104.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-15T03:18:53.752 INFO:teuthology.orchestra.run.smithi104.stdout:Device: 5h/5d Inode: 550 Links: 1 Device type: 103,8 2024-09-15T03:18:53.752 INFO:teuthology.orchestra.run.smithi104.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-15T03:18:53.753 INFO:teuthology.orchestra.run.smithi104.stdout:Access: 2024-09-15 03:18:04.563655713 +0000 2024-09-15T03:18:53.753 INFO:teuthology.orchestra.run.smithi104.stdout:Modify: 2024-09-15 03:14:55.946558478 +0000 2024-09-15T03:18:53.753 INFO:teuthology.orchestra.run.smithi104.stdout:Change: 2024-09-15 03:14:55.946558478 +0000 2024-09-15T03:18:53.753 INFO:teuthology.orchestra.run.smithi104.stdout: Birth: - 2024-09-15T03:18:53.753 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2024-09-15T03:18:53.807 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records in 2024-09-15T03:18:53.807 INFO:teuthology.orchestra.run.smithi104.stderr:1+0 records out 2024-09-15T03:18:53.807 INFO:teuthology.orchestra.run.smithi104.stderr:512 bytes copied, 0.000284284 s, 1.8 MB/s 2024-09-15T03:18:53.808 DEBUG:teuthology.orchestra.run.smithi104:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2024-09-15T03:18:53.855 INFO:tasks.cephadm:Deploying osd.0 on smithi053 with /dev/nvme4n1... 2024-09-15T03:18:53.856 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme4n1 2024-09-15T03:18:54.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:54 smithi104 bash[15781]: cluster 2024-09-15T03:18:53.397526+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:54.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:54 smithi104 bash[15781]: audit 2024-09-15T03:18:53.771800+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:54.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:54 smithi104 bash[15781]: audit 2024-09-15T03:18:53.777249+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:54.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:54 smithi104 bash[15781]: audit 2024-09-15T03:18:53.783761+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:55.075 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[21662]: cluster 2024-09-15T03:18:53.397526+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:55.075 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[21662]: audit 2024-09-15T03:18:53.771800+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:55.075 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[21662]: audit 2024-09-15T03:18:53.777249+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:55.076 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[21662]: audit 2024-09-15T03:18:53.783761+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:55.076 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[15077]: cluster 2024-09-15T03:18:53.397526+0000 mgr.y (mgr.14150) 93 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:55.076 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[15077]: audit 2024-09-15T03:18:53.771800+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:55.076 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[15077]: audit 2024-09-15T03:18:53.777249+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:55.076 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:54 smithi053 bash[15077]: audit 2024-09-15T03:18:53.783761+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.140 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:56 smithi104 bash[17508]: debug 2024-09-15T03:18:56.003+0000 7fb1b495b640 1 -- 172.21.15.104:0/3836516888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55df33794340 con 0x55df337a0800 2024-09-15T03:18:56.141 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:56 smithi104 bash[17508]: debug 2024-09-15T03:18:56.131+0000 7fb1b71c3ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T03:18:56.141 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.845667+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.141 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.850621+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.141 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.856067+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.141 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.862331+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.141 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.903891+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.907189+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.908560+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.916083+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: cephadm 2024-09-15T03:18:54.916723+0000 mgr.y (mgr.14150) 94 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: cephadm 2024-09-15T03:18:54.960059+0000 mgr.y (mgr.14150) 95 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.960734+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.962325+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:54.963615+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: cephadm 2024-09-15T03:18:54.964866+0000 mgr.y (mgr.14150) 96 : cephadm [INF] Reconfiguring daemon mgr.y on smithi053 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:55.282217+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:55.287697+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: audit 2024-09-15T03:18:55.293365+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.142 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:55 smithi104 bash[15781]: cluster 2024-09-15T03:18:55.397790+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.845667+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.850621+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.856067+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.862331+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.903891+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.907189+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.908560+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.916083+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: cephadm 2024-09-15T03:18:54.916723+0000 mgr.y (mgr.14150) 94 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:18:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: cephadm 2024-09-15T03:18:54.960059+0000 mgr.y (mgr.14150) 95 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.960734+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.962325+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:54.963615+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: cephadm 2024-09-15T03:18:54.964866+0000 mgr.y (mgr.14150) 96 : cephadm [INF] Reconfiguring daemon mgr.y on smithi053 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:55.282217+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:55.287697+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: audit 2024-09-15T03:18:55.293365+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[15077]: cluster 2024-09-15T03:18:55.397790+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.845667+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.850621+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.856067+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.862331+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.903891+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.907189+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.908560+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.916083+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: cephadm 2024-09-15T03:18:54.916723+0000 mgr.y (mgr.14150) 94 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: cephadm 2024-09-15T03:18:54.960059+0000 mgr.y (mgr.14150) 95 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.960734+0000 mon.a (mon.0) 290 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.962325+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:54.963615+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: cephadm 2024-09-15T03:18:54.964866+0000 mgr.y (mgr.14150) 96 : cephadm [INF] Reconfiguring daemon mgr.y on smithi053 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:55.282217+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:55.287697+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: audit 2024-09-15T03:18:55.293365+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:56.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:55 smithi053 bash[21662]: cluster 2024-09-15T03:18:55.397790+0000 mgr.y (mgr.14150) 97 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:57.227 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:56 smithi104 bash[17508]: debug 2024-09-15T03:18:56.931+0000 7fb1b71c3ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T03:18:57.227 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:57 smithi104 bash[17508]: debug 2024-09-15T03:18:56.999+0000 7fb1b71c3ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T03:18:57.227 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:57 smithi104 bash[17508]: debug 2024-09-15T03:18:57.067+0000 7fb1b71c3ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T03:18:57.227 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:57 smithi104 bash[17508]: debug 2024-09-15T03:18:57.219+0000 7fb1b71c3ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:18:57.732 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:57 smithi104 bash[17508]: debug 2024-09-15T03:18:57.479+0000 7fb1b71c3ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T03:18:57.732 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:57 smithi104 bash[17508]: debug 2024-09-15T03:18:57.539+0000 7fb1b71c3ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T03:18:57.732 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:57 smithi104 bash[17508]: debug 2024-09-15T03:18:57.675+0000 7fb1b71c3ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T03:18:58.039 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:18:58.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: audit 2024-09-15T03:18:57.048372+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: audit 2024-09-15T03:18:57.053090+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: audit 2024-09-15T03:18:57.055552+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:58.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: audit 2024-09-15T03:18:57.058547+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:58.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: audit 2024-09-15T03:18:57.059554+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:58.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: audit 2024-09-15T03:18:57.065416+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: cephadm 2024-09-15T03:18:57.066015+0000 mgr.y (mgr.14150) 98 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:18:58.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[15781]: cluster 2024-09-15T03:18:57.398177+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:58.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: audit 2024-09-15T03:18:57.048372+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: audit 2024-09-15T03:18:57.053090+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: audit 2024-09-15T03:18:57.055552+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:58.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: audit 2024-09-15T03:18:57.058547+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:58.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: audit 2024-09-15T03:18:57.059554+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:58.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: audit 2024-09-15T03:18:57.065416+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: cephadm 2024-09-15T03:18:57.066015+0000 mgr.y (mgr.14150) 98 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[21662]: cluster 2024-09-15T03:18:57.398177+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: audit 2024-09-15T03:18:57.048372+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: audit 2024-09-15T03:18:57.053090+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: audit 2024-09-15T03:18:57.055552+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: audit 2024-09-15T03:18:57.058547+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: audit 2024-09-15T03:18:57.059554+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: audit 2024-09-15T03:18:57.065416+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: cephadm 2024-09-15T03:18:57.066015+0000 mgr.y (mgr.14150) 98 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:18:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:58 smithi053 bash[15077]: cluster 2024-09-15T03:18:57.398177+0000 mgr.y (mgr.14150) 99 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:18:58.732 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[17508]: debug 2024-09-15T03:18:58.343+0000 7fb1b71c3ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T03:18:58.732 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[17508]: debug 2024-09-15T03:18:58.411+0000 7fb1b71c3ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T03:18:58.733 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[17508]: debug 2024-09-15T03:18:58.491+0000 7fb1b71c3ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T03:18:59.035 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[17508]: debug 2024-09-15T03:18:58.775+0000 7fb1b71c3ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T03:18:59.035 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:58 smithi104 bash[17508]: debug 2024-09-15T03:18:58.915+0000 7fb1b71c3ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T03:18:59.477 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:59 smithi104 bash[17508]: debug 2024-09-15T03:18:59.251+0000 7fb1b71c3ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T03:18:59.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:18:59 smithi053 bash[15077]: audit 2024-09-15T03:18:58.484625+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:59.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:18:59 smithi053 bash[21662]: audit 2024-09-15T03:18:58.484625+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:18:59 smithi104 bash[15781]: audit 2024-09-15T03:18:58.484625+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:18:59.733 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:59 smithi104 bash[17508]: debug 2024-09-15T03:18:59.471+0000 7fb1b71c3ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:19:00.223 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:18:59 smithi104 bash[17508]: debug 2024-09-15T03:18:59.919+0000 7fb1b71c3ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T03:19:00.223 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[17508]: debug 2024-09-15T03:18:59.983+0000 7fb1b71c3ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T03:19:00.223 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[17508]: debug 2024-09-15T03:19:00.055+0000 7fb1b71c3ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T03:19:00.223 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[17508]: debug 2024-09-15T03:19:00.147+0000 7fb1b71c3ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T03:19:00.223 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[17508]: debug 2024-09-15T03:19:00.219+0000 7fb1b71c3ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T03:19:00.482 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[17508]: debug 2024-09-15T03:19:00.299+0000 7fb1b71c3ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T03:19:00.482 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[17508]: debug 2024-09-15T03:19:00.447+0000 7fb1b71c3ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T03:19:00.776 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:00 smithi053 bash[15077]: cluster 2024-09-15T03:18:59.398659+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:00.776 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:00 smithi053 bash[21662]: cluster 2024-09-15T03:18:59.398659+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:00.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[15781]: cluster 2024-09-15T03:18:59.398659+0000 mgr.y (mgr.14150) 100 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:00.983 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:00 smithi104 bash[17508]: debug 2024-09-15T03:19:00.527+0000 7fb1b71c3ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T03:19:01.307 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/nvme4n1 2024-09-15T03:19:01.307 INFO:teuthology.orchestra.run.smithi053.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:19:01.313 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme4n1 bs=1M count=10 conv=fsync 2024-09-15T03:19:01.331 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2024-09-15T03:19:01.331 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2024-09-15T03:19:01.331 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.014125 s, 742 MB/s 2024-09-15T03:19:01.331 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2024-09-15T03:19:01.732 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:19:01 smithi104 bash[17508]: debug 2024-09-15T03:19:01.499+0000 7fb1b71c3ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T03:19:02.006 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi053:/dev/nvme4n1 2024-09-15T03:19:02.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[15077]: audit 2024-09-15T03:19:01.281985+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:02.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[15077]: cluster 2024-09-15T03:19:01.399129+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:02.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[15077]: cluster 2024-09-15T03:19:01.524671+0000 mon.a (mon.0) 304 : cluster [DBG] Standby manager daemon x started 2024-09-15T03:19:02.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[15077]: audit 2024-09-15T03:19:01.526768+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-15T03:19:02.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[15077]: audit 2024-09-15T03:19:01.527499+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T03:19:02.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[15077]: audit 2024-09-15T03:19:01.529173+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-15T03:19:02.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[15077]: audit 2024-09-15T03:19:01.529954+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T03:19:02.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[21662]: audit 2024-09-15T03:19:01.281985+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:02.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[21662]: cluster 2024-09-15T03:19:01.399129+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:02.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[21662]: cluster 2024-09-15T03:19:01.524671+0000 mon.a (mon.0) 304 : cluster [DBG] Standby manager daemon x started 2024-09-15T03:19:02.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[21662]: audit 2024-09-15T03:19:01.526768+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-15T03:19:02.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[21662]: audit 2024-09-15T03:19:01.527499+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T03:19:02.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[21662]: audit 2024-09-15T03:19:01.529173+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-15T03:19:02.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:02 smithi053 bash[21662]: audit 2024-09-15T03:19:01.529954+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T03:19:02.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:02 smithi104 bash[15781]: audit 2024-09-15T03:19:01.281985+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:02.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:02 smithi104 bash[15781]: cluster 2024-09-15T03:19:01.399129+0000 mgr.y (mgr.14150) 101 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:02.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:02 smithi104 bash[15781]: cluster 2024-09-15T03:19:01.524671+0000 mon.a (mon.0) 304 : cluster [DBG] Standby manager daemon x started 2024-09-15T03:19:02.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:02 smithi104 bash[15781]: audit 2024-09-15T03:19:01.526768+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-15T03:19:02.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:02 smithi104 bash[15781]: audit 2024-09-15T03:19:01.527499+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T03:19:02.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:02 smithi104 bash[15781]: audit 2024-09-15T03:19:01.529173+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-15T03:19:02.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:02 smithi104 bash[15781]: audit 2024-09-15T03:19:01.529954+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.104:0/2666111517' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T03:19:03.632 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:03 smithi104 bash[15781]: cluster 2024-09-15T03:19:02.295475+0000 mon.a (mon.0) 305 : cluster [DBG] mgrmap e14: y(active, since 118s), standbys: x 2024-09-15T03:19:03.632 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:03 smithi104 bash[15781]: audit 2024-09-15T03:19:02.295618+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T03:19:03.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:03 smithi053 bash[15077]: cluster 2024-09-15T03:19:02.295475+0000 mon.a (mon.0) 305 : cluster [DBG] mgrmap e14: y(active, since 118s), standbys: x 2024-09-15T03:19:03.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:03 smithi053 bash[15077]: audit 2024-09-15T03:19:02.295618+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T03:19:03.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:03 smithi053 bash[21662]: cluster 2024-09-15T03:19:02.295475+0000 mon.a (mon.0) 305 : cluster [DBG] mgrmap e14: y(active, since 118s), standbys: x 2024-09-15T03:19:03.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:03 smithi053 bash[21662]: audit 2024-09-15T03:19:02.295618+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T03:19:04.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: cluster 2024-09-15T03:19:03.399628+0000 mgr.y (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:04.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: audit 2024-09-15T03:19:04.147645+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: audit 2024-09-15T03:19:04.153655+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: audit 2024-09-15T03:19:04.157006+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:04.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: audit 2024-09-15T03:19:04.160499+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: audit 2024-09-15T03:19:04.164029+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:04.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: audit 2024-09-15T03:19:04.165390+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:04.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:04 smithi104 bash[15781]: audit 2024-09-15T03:19:04.172540+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: cluster 2024-09-15T03:19:03.399628+0000 mgr.y (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: audit 2024-09-15T03:19:04.147645+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: audit 2024-09-15T03:19:04.153655+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: audit 2024-09-15T03:19:04.157006+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: audit 2024-09-15T03:19:04.160499+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: audit 2024-09-15T03:19:04.164029+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:04.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: audit 2024-09-15T03:19:04.165390+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[15077]: audit 2024-09-15T03:19:04.172540+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: cluster 2024-09-15T03:19:03.399628+0000 mgr.y (mgr.14150) 102 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: audit 2024-09-15T03:19:04.147645+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: audit 2024-09-15T03:19:04.153655+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: audit 2024-09-15T03:19:04.157006+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: audit 2024-09-15T03:19:04.160499+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: audit 2024-09-15T03:19:04.164029+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: audit 2024-09-15T03:19:04.165390+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:04.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:04 smithi053 bash[21662]: audit 2024-09-15T03:19:04.172540+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:06.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:06 smithi104 bash[15781]: cluster 2024-09-15T03:19:05.400100+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:06.741 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:19:06.846 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:06 smithi053 bash[15077]: cluster 2024-09-15T03:19:05.400100+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:06.847 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:06 smithi053 bash[21662]: cluster 2024-09-15T03:19:05.400100+0000 mgr.y (mgr.14150) 103 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:08.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:08 smithi104 bash[15781]: cluster 2024-09-15T03:19:07.400589+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:08.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:08 smithi053 bash[15077]: cluster 2024-09-15T03:19:07.400589+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:08.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:08 smithi053 bash[21662]: cluster 2024-09-15T03:19:07.400589+0000 mgr.y (mgr.14150) 104 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:10.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:10 smithi104 bash[15781]: cluster 2024-09-15T03:19:09.401014+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:10.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:10 smithi104 bash[15781]: audit 2024-09-15T03:19:10.291677+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:19:10.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:10 smithi104 bash[15781]: audit 2024-09-15T03:19:10.296847+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:19:10.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:10 smithi104 bash[15781]: audit 2024-09-15T03:19:10.297642+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:10.738 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[15077]: cluster 2024-09-15T03:19:09.401014+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:10.738 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[15077]: audit 2024-09-15T03:19:10.291677+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:19:10.738 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[15077]: audit 2024-09-15T03:19:10.296847+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:19:10.739 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[15077]: audit 2024-09-15T03:19:10.297642+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:10.739 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[21662]: cluster 2024-09-15T03:19:09.401014+0000 mgr.y (mgr.14150) 105 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:10.739 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[21662]: audit 2024-09-15T03:19:10.291677+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:19:10.739 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[21662]: audit 2024-09-15T03:19:10.296847+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:19:10.739 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:10 smithi053 bash[21662]: audit 2024-09-15T03:19:10.297642+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:11.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:11 smithi104 bash[15781]: audit 2024-09-15T03:19:10.285362+0000 mgr.y (mgr.14150) 106 : audit [DBG] from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:19:11.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:11 smithi053 bash[15077]: audit 2024-09-15T03:19:10.285362+0000 mgr.y (mgr.14150) 106 : audit [DBG] from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:19:11.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:11 smithi053 bash[21662]: audit 2024-09-15T03:19:10.285362+0000 mgr.y (mgr.14150) 106 : audit [DBG] from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:19:12.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:12 smithi053 bash[15077]: cluster 2024-09-15T03:19:11.401353+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:12.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:12 smithi053 bash[21662]: cluster 2024-09-15T03:19:11.401353+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:12.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:12 smithi104 bash[15781]: cluster 2024-09-15T03:19:11.401353+0000 mgr.y (mgr.14150) 107 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:14.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:14 smithi053 bash[15077]: cluster 2024-09-15T03:19:13.401724+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:14.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:14 smithi053 bash[21662]: cluster 2024-09-15T03:19:13.401724+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:14.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:14 smithi104 bash[15781]: cluster 2024-09-15T03:19:13.401724+0000 mgr.y (mgr.14150) 108 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:16.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[15077]: cluster 2024-09-15T03:19:15.402144+0000 mgr.y (mgr.14150) 109 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:16.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[15077]: audit 2024-09-15T03:19:15.495159+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[15077]: audit 2024-09-15T03:19:15.501217+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[15077]: audit 2024-09-15T03:19:15.508285+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[21662]: cluster 2024-09-15T03:19:15.402144+0000 mgr.y (mgr.14150) 109 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:16.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[21662]: audit 2024-09-15T03:19:15.495159+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[21662]: audit 2024-09-15T03:19:15.501217+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:16 smithi053 bash[21662]: audit 2024-09-15T03:19:15.508285+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:16 smithi104 bash[15781]: cluster 2024-09-15T03:19:15.402144+0000 mgr.y (mgr.14150) 109 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:16.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:16 smithi104 bash[15781]: audit 2024-09-15T03:19:15.495159+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:16 smithi104 bash[15781]: audit 2024-09-15T03:19:15.501217+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:16.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:16 smithi104 bash[15781]: audit 2024-09-15T03:19:15.508285+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:18.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:18 smithi053 bash[15077]: cluster 2024-09-15T03:19:17.402596+0000 mgr.y (mgr.14150) 110 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:18.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:18 smithi053 bash[21662]: cluster 2024-09-15T03:19:17.402596+0000 mgr.y (mgr.14150) 110 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:18.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:18 smithi104 bash[15781]: cluster 2024-09-15T03:19:17.402596+0000 mgr.y (mgr.14150) 110 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:20.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[21662]: cluster 2024-09-15T03:19:19.402989+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:20.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[21662]: audit 2024-09-15T03:19:20.029515+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.53:0/459299942' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]: dispatch 2024-09-15T03:19:20.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[21662]: audit 2024-09-15T03:19:20.030197+0000 mon.a (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]: dispatch 2024-09-15T03:19:20.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[21662]: audit 2024-09-15T03:19:20.035967+0000 mon.a (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]': finished 2024-09-15T03:19:20.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[21662]: cluster 2024-09-15T03:19:20.036042+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-15T03:19:20.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[21662]: audit 2024-09-15T03:19:20.036169+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:20.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[15077]: cluster 2024-09-15T03:19:19.402989+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:20.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[15077]: audit 2024-09-15T03:19:20.029515+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.53:0/459299942' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]: dispatch 2024-09-15T03:19:20.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[15077]: audit 2024-09-15T03:19:20.030197+0000 mon.a (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]: dispatch 2024-09-15T03:19:20.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[15077]: audit 2024-09-15T03:19:20.035967+0000 mon.a (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]': finished 2024-09-15T03:19:20.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[15077]: cluster 2024-09-15T03:19:20.036042+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-15T03:19:20.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:20 smithi053 bash[15077]: audit 2024-09-15T03:19:20.036169+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:20.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:20 smithi104 bash[15781]: cluster 2024-09-15T03:19:19.402989+0000 mgr.y (mgr.14150) 111 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:20.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:20 smithi104 bash[15781]: audit 2024-09-15T03:19:20.029515+0000 mon.c (mon.2) 2 : audit [INF] from='client.? 172.21.15.53:0/459299942' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]: dispatch 2024-09-15T03:19:20.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:20 smithi104 bash[15781]: audit 2024-09-15T03:19:20.030197+0000 mon.a (mon.0) 320 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]: dispatch 2024-09-15T03:19:20.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:20 smithi104 bash[15781]: audit 2024-09-15T03:19:20.035967+0000 mon.a (mon.0) 321 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "979ed5a1-4f04-4b3d-8cde-e20ffdacd018"}]': finished 2024-09-15T03:19:20.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:20 smithi104 bash[15781]: cluster 2024-09-15T03:19:20.036042+0000 mon.a (mon.0) 322 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2024-09-15T03:19:20.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:20 smithi104 bash[15781]: audit 2024-09-15T03:19:20.036169+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[15077]: cluster 2024-09-15T03:19:21.403400+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[15077]: audit 2024-09-15T03:19:21.613042+0000 mon.a (mon.0) 324 : audit [DBG] from='client.? 172.21.15.53:0/4153013174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:19:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[15077]: audit 2024-09-15T03:19:21.773908+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[15077]: audit 2024-09-15T03:19:21.779315+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[15077]: audit 2024-09-15T03:19:21.786033+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[21662]: cluster 2024-09-15T03:19:21.403400+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[21662]: audit 2024-09-15T03:19:21.613042+0000 mon.a (mon.0) 324 : audit [DBG] from='client.? 172.21.15.53:0/4153013174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:19:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[21662]: audit 2024-09-15T03:19:21.773908+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[21662]: audit 2024-09-15T03:19:21.779315+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:22 smithi053 bash[21662]: audit 2024-09-15T03:19:21.786033+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:22 smithi104 bash[15781]: cluster 2024-09-15T03:19:21.403400+0000 mgr.y (mgr.14150) 112 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:22.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:22 smithi104 bash[15781]: audit 2024-09-15T03:19:21.613042+0000 mon.a (mon.0) 324 : audit [DBG] from='client.? 172.21.15.53:0/4153013174' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:19:22.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:22 smithi104 bash[15781]: audit 2024-09-15T03:19:21.773908+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:22 smithi104 bash[15781]: audit 2024-09-15T03:19:21.779315+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:22.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:22 smithi104 bash[15781]: audit 2024-09-15T03:19:21.786033+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:24.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:24 smithi053 bash[15077]: cluster 2024-09-15T03:19:23.403774+0000 mgr.y (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:24.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:24 smithi053 bash[21662]: cluster 2024-09-15T03:19:23.403774+0000 mgr.y (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:24.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:24 smithi104 bash[15781]: cluster 2024-09-15T03:19:23.403774+0000 mgr.y (mgr.14150) 113 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:26.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:26 smithi053 bash[15077]: cluster 2024-09-15T03:19:25.404182+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:26.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:26 smithi053 bash[21662]: cluster 2024-09-15T03:19:25.404182+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:26.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:26 smithi104 bash[15781]: cluster 2024-09-15T03:19:25.404182+0000 mgr.y (mgr.14150) 114 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:28.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:28 smithi053 bash[15077]: cluster 2024-09-15T03:19:27.404644+0000 mgr.y (mgr.14150) 115 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:28.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:28 smithi053 bash[21662]: cluster 2024-09-15T03:19:27.404644+0000 mgr.y (mgr.14150) 115 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:28.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:28 smithi104 bash[15781]: cluster 2024-09-15T03:19:27.404644+0000 mgr.y (mgr.14150) 115 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:30.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:30 smithi053 bash[15077]: cluster 2024-09-15T03:19:29.405117+0000 mgr.y (mgr.14150) 116 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:30.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:30 smithi053 bash[21662]: cluster 2024-09-15T03:19:29.405117+0000 mgr.y (mgr.14150) 116 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:30.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:30 smithi104 bash[15781]: cluster 2024-09-15T03:19:29.405117+0000 mgr.y (mgr.14150) 116 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:32.623 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:32 smithi053 bash[15077]: cluster 2024-09-15T03:19:31.405588+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:32.623 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:32 smithi053 bash[21662]: cluster 2024-09-15T03:19:31.405588+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:32.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:32 smithi104 bash[15781]: cluster 2024-09-15T03:19:31.405588+0000 mgr.y (mgr.14150) 117 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:34.786 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:34 smithi053 bash[15077]: cluster 2024-09-15T03:19:33.405991+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:34.787 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:34 smithi053 bash[21662]: cluster 2024-09-15T03:19:33.405991+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:34.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:34 smithi104 bash[15781]: cluster 2024-09-15T03:19:33.405991+0000 mgr.y (mgr.14150) 118 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:35.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:35 smithi053 bash[15077]: audit 2024-09-15T03:19:34.629255+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T03:19:35.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:35 smithi053 bash[15077]: audit 2024-09-15T03:19:34.630823+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:35.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:35 smithi053 bash[15077]: cephadm 2024-09-15T03:19:34.632025+0000 mgr.y (mgr.14150) 119 : cephadm [INF] Deploying daemon osd.0 on smithi053 2024-09-15T03:19:35.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:35 smithi053 bash[21662]: audit 2024-09-15T03:19:34.629255+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T03:19:35.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:35 smithi053 bash[21662]: audit 2024-09-15T03:19:34.630823+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:35.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:35 smithi053 bash[21662]: cephadm 2024-09-15T03:19:34.632025+0000 mgr.y (mgr.14150) 119 : cephadm [INF] Deploying daemon osd.0 on smithi053 2024-09-15T03:19:35.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:35 smithi104 bash[15781]: audit 2024-09-15T03:19:34.629255+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T03:19:35.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:35 smithi104 bash[15781]: audit 2024-09-15T03:19:34.630823+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:35.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:35 smithi104 bash[15781]: cephadm 2024-09-15T03:19:34.632025+0000 mgr.y (mgr.14150) 119 : cephadm [INF] Deploying daemon osd.0 on smithi053 2024-09-15T03:19:36.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[21662]: cluster 2024-09-15T03:19:35.406398+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:36.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[21662]: audit 2024-09-15T03:19:35.713038+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[21662]: audit 2024-09-15T03:19:35.719413+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[21662]: audit 2024-09-15T03:19:35.726157+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[15077]: cluster 2024-09-15T03:19:35.406398+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:36.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[15077]: audit 2024-09-15T03:19:35.713038+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[15077]: audit 2024-09-15T03:19:35.719413+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:36 smithi053 bash[15077]: audit 2024-09-15T03:19:35.726157+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:36 smithi104 bash[15781]: cluster 2024-09-15T03:19:35.406398+0000 mgr.y (mgr.14150) 120 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:36.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:36 smithi104 bash[15781]: audit 2024-09-15T03:19:35.713038+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:36 smithi104 bash[15781]: audit 2024-09-15T03:19:35.719413+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:36.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:36 smithi104 bash[15781]: audit 2024-09-15T03:19:35.726157+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:38.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:38 smithi053 bash[21662]: cluster 2024-09-15T03:19:37.406807+0000 mgr.y (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:38.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:38 smithi053 bash[15077]: cluster 2024-09-15T03:19:37.406807+0000 mgr.y (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:38.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:38 smithi104 bash[15781]: cluster 2024-09-15T03:19:37.406807+0000 mgr.y (mgr.14150) 121 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:40.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:40 smithi053 bash[21662]: cluster 2024-09-15T03:19:39.407228+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:40.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:40 smithi053 bash[15077]: cluster 2024-09-15T03:19:39.407228+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:40 smithi104 bash[15781]: cluster 2024-09-15T03:19:39.407228+0000 mgr.y (mgr.14150) 122 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:41.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[21662]: audit 2024-09-15T03:19:41.566309+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:42.016 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[21662]: audit 2024-09-15T03:19:41.571372+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.016 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[21662]: audit 2024-09-15T03:19:41.571768+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:42.016 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[21662]: audit 2024-09-15T03:19:41.573344+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:42.016 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[21662]: audit 2024-09-15T03:19:41.578012+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.016 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[21662]: audit 2024-09-15T03:19:41.582070+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[15077]: audit 2024-09-15T03:19:41.566309+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:42.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[15077]: audit 2024-09-15T03:19:41.571372+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[15077]: audit 2024-09-15T03:19:41.571768+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:42.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[15077]: audit 2024-09-15T03:19:41.573344+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:42.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[15077]: audit 2024-09-15T03:19:41.578012+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.017 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:41 smithi053 bash[15077]: audit 2024-09-15T03:19:41.582070+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.017 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:41 smithi104 bash[15781]: audit 2024-09-15T03:19:41.566309+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:42.018 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:41 smithi104 bash[15781]: audit 2024-09-15T03:19:41.571372+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.018 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:41 smithi104 bash[15781]: audit 2024-09-15T03:19:41.571768+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:42.018 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:41 smithi104 bash[15781]: audit 2024-09-15T03:19:41.573344+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:42.018 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:41 smithi104 bash[15781]: audit 2024-09-15T03:19:41.578012+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.018 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:41 smithi104 bash[15781]: audit 2024-09-15T03:19:41.582070+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:42 smithi104 bash[15781]: cluster 2024-09-15T03:19:41.407639+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:42 smithi104 bash[15781]: audit 2024-09-15T03:19:41.991858+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:42 smithi104 bash[15781]: audit 2024-09-15T03:19:41.997458+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:42 smithi104 bash[15781]: audit 2024-09-15T03:19:42.003791+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:43.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[15077]: cluster 2024-09-15T03:19:41.407639+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:43.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[15077]: audit 2024-09-15T03:19:41.991858+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:43.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[15077]: audit 2024-09-15T03:19:41.997458+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:43.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[15077]: audit 2024-09-15T03:19:42.003791+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:43.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[21662]: cluster 2024-09-15T03:19:41.407639+0000 mgr.y (mgr.14150) 123 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:43.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[21662]: audit 2024-09-15T03:19:41.991858+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:43.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[21662]: audit 2024-09-15T03:19:41.997458+0000 mon.a (mon.0) 340 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:42 smithi053 bash[21662]: audit 2024-09-15T03:19:42.003791+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:45.045 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:44 smithi053 bash[15077]: cluster 2024-09-15T03:19:43.408047+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:45.045 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:44 smithi053 bash[21662]: cluster 2024-09-15T03:19:43.408047+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:45.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:44 smithi104 bash[15781]: cluster 2024-09-15T03:19:43.408047+0000 mgr.y (mgr.14150) 124 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:46 smithi053 bash[15077]: cluster 2024-09-15T03:19:45.408563+0000 mgr.y (mgr.14150) 125 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:47.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:46 smithi053 bash[21662]: cluster 2024-09-15T03:19:45.408563+0000 mgr.y (mgr.14150) 125 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:47.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:46 smithi104 bash[15781]: cluster 2024-09-15T03:19:45.408563+0000 mgr.y (mgr.14150) 125 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:48.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:48 smithi053 bash[15077]: cluster 2024-09-15T03:19:47.408958+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:48.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:48 smithi053 bash[15077]: audit 2024-09-15T03:19:48.662782+0000 mon.a (mon.0) 342 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T03:19:48.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:48 smithi053 bash[21662]: cluster 2024-09-15T03:19:47.408958+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:48.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:48 smithi053 bash[21662]: audit 2024-09-15T03:19:48.662782+0000 mon.a (mon.0) 342 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T03:19:49.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:48 smithi104 bash[15781]: cluster 2024-09-15T03:19:47.408958+0000 mgr.y (mgr.14150) 126 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:49.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:48 smithi104 bash[15781]: audit 2024-09-15T03:19:48.662782+0000 mon.a (mon.0) 342 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T03:19:49.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[15077]: audit 2024-09-15T03:19:48.747813+0000 mon.a (mon.0) 343 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T03:19:49.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[15077]: cluster 2024-09-15T03:19:48.747904+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-15T03:19:49.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[15077]: audit 2024-09-15T03:19:48.748139+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:49.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[15077]: audit 2024-09-15T03:19:48.748767+0000 mon.a (mon.0) 346 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:19:49.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[21662]: audit 2024-09-15T03:19:48.747813+0000 mon.a (mon.0) 343 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T03:19:49.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[21662]: cluster 2024-09-15T03:19:48.747904+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-15T03:19:49.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[21662]: audit 2024-09-15T03:19:48.748139+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:49.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:49 smithi053 bash[21662]: audit 2024-09-15T03:19:48.748767+0000 mon.a (mon.0) 346 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:19:50.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:49 smithi104 bash[15781]: audit 2024-09-15T03:19:48.747813+0000 mon.a (mon.0) 343 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T03:19:50.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:49 smithi104 bash[15781]: cluster 2024-09-15T03:19:48.747904+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-09-15T03:19:50.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:49 smithi104 bash[15781]: audit 2024-09-15T03:19:48.748139+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:50.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:49 smithi104 bash[15781]: audit 2024-09-15T03:19:48.748767+0000 mon.a (mon.0) 346 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:19:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[21662]: cluster 2024-09-15T03:19:49.409362+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[21662]: audit 2024-09-15T03:19:49.751006+0000 mon.a (mon.0) 347 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:19:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[21662]: cluster 2024-09-15T03:19:49.751123+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-15T03:19:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[21662]: audit 2024-09-15T03:19:49.751613+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[21662]: audit 2024-09-15T03:19:49.759084+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[15077]: cluster 2024-09-15T03:19:49.409362+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[15077]: audit 2024-09-15T03:19:49.751006+0000 mon.a (mon.0) 347 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:19:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[15077]: cluster 2024-09-15T03:19:49.751123+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-15T03:19:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[15077]: audit 2024-09-15T03:19:49.751613+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:50 smithi053 bash[15077]: audit 2024-09-15T03:19:49.759084+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:51.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:50 smithi104 bash[15781]: cluster 2024-09-15T03:19:49.409362+0000 mgr.y (mgr.14150) 127 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:51.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:50 smithi104 bash[15781]: audit 2024-09-15T03:19:49.751006+0000 mon.a (mon.0) 347 : audit [INF] from='osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:19:51.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:50 smithi104 bash[15781]: cluster 2024-09-15T03:19:49.751123+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-09-15T03:19:51.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:50 smithi104 bash[15781]: audit 2024-09-15T03:19:49.751613+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:51.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:50 smithi104 bash[15781]: audit 2024-09-15T03:19:49.759084+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:51.705 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 0 on host 'smithi053' 2024-09-15T03:19:52.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: cluster 2024-09-15T03:19:49.611413+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:19:52.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: cluster 2024-09-15T03:19:49.611521+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:50.761105+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: cluster 2024-09-15T03:19:50.764771+0000 mon.a (mon.0) 352 : cluster [INF] osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896] boot 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: cluster 2024-09-15T03:19:50.764806+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:50.764953+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.690083+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.697214+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.697709+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.703440+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.711620+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.713334+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.714378+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[15077]: audit 2024-09-15T03:19:51.720708+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: cluster 2024-09-15T03:19:49.611413+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: cluster 2024-09-15T03:19:49.611521+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:50.761105+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: cluster 2024-09-15T03:19:50.764771+0000 mon.a (mon.0) 352 : cluster [INF] osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896] boot 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: cluster 2024-09-15T03:19:50.764806+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:50.764953+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.690083+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.697214+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.697709+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.703440+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.711620+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.713334+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:52.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.714378+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:52.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:51 smithi053 bash[21662]: audit 2024-09-15T03:19:51.720708+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: cluster 2024-09-15T03:19:49.611413+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:19:52.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: cluster 2024-09-15T03:19:49.611521+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:19:52.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:50.761105+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:52.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: cluster 2024-09-15T03:19:50.764771+0000 mon.a (mon.0) 352 : cluster [INF] osd.0 [v2:172.21.15.53:6802/3384339896,v1:172.21.15.53:6803/3384339896] boot 2024-09-15T03:19:52.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: cluster 2024-09-15T03:19:50.764806+0000 mon.a (mon.0) 353 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2024-09-15T03:19:52.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:50.764953+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:19:52.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.690083+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:52.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.697214+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.697709+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:19:52.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.703440+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.711620+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.713334+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:52.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.714378+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:52.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:51 smithi104 bash[15781]: audit 2024-09-15T03:19:51.720708+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:52.369 DEBUG:teuthology.orchestra.run.smithi053:osd.0> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T03:19:52.371 INFO:tasks.cephadm:Deploying osd.1 on smithi053 with /dev/nvme3n1... 2024-09-15T03:19:52.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme3n1 2024-09-15T03:19:53.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:52 smithi053 bash[21662]: cluster 2024-09-15T03:19:51.409675+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:53.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:52 smithi053 bash[21662]: cephadm 2024-09-15T03:19:51.700097+0000 mgr.y (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 15221M 2024-09-15T03:19:53.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:52 smithi053 bash[21662]: cluster 2024-09-15T03:19:51.773760+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-15T03:19:53.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:52 smithi053 bash[15077]: cluster 2024-09-15T03:19:51.409675+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:53.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:52 smithi053 bash[15077]: cephadm 2024-09-15T03:19:51.700097+0000 mgr.y (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 15221M 2024-09-15T03:19:53.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:52 smithi053 bash[15077]: cluster 2024-09-15T03:19:51.773760+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-15T03:19:53.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:52 smithi104 bash[15781]: cluster 2024-09-15T03:19:51.409675+0000 mgr.y (mgr.14150) 128 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T03:19:53.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:52 smithi104 bash[15781]: cephadm 2024-09-15T03:19:51.700097+0000 mgr.y (mgr.14150) 129 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 15221M 2024-09-15T03:19:53.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:52 smithi104 bash[15781]: cluster 2024-09-15T03:19:51.773760+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-09-15T03:19:53.569 INFO:journalctl@ceph.osd.0.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:19:55.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:54 smithi053 bash[15077]: cluster 2024-09-15T03:19:53.410053+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:55.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:54 smithi053 bash[21662]: cluster 2024-09-15T03:19:53.410053+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:55.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:54 smithi104 bash[15781]: cluster 2024-09-15T03:19:53.410053+0000 mgr.y (mgr.14150) 130 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:56.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: cluster 2024-09-15T03:19:55.410493+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:56.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: audit 2024-09-15T03:19:55.919054+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:56.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: audit 2024-09-15T03:19:55.924991+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:56.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: audit 2024-09-15T03:19:55.928270+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:56.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: audit 2024-09-15T03:19:55.931416+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: audit 2024-09-15T03:19:55.934742+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: audit 2024-09-15T03:19:55.935713+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[15077]: audit 2024-09-15T03:19:55.941844+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: cluster 2024-09-15T03:19:55.410493+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: audit 2024-09-15T03:19:55.919054+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: audit 2024-09-15T03:19:55.924991+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: audit 2024-09-15T03:19:55.928270+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: audit 2024-09-15T03:19:55.931416+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: audit 2024-09-15T03:19:55.934742+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: audit 2024-09-15T03:19:55.935713+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:56.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:56 smithi053 bash[21662]: audit 2024-09-15T03:19:55.941844+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: cluster 2024-09-15T03:19:55.410493+0000 mgr.y (mgr.14150) 131 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: audit 2024-09-15T03:19:55.919054+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: audit 2024-09-15T03:19:55.924991+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: audit 2024-09-15T03:19:55.928270+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: audit 2024-09-15T03:19:55.931416+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: audit 2024-09-15T03:19:55.934742+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: audit 2024-09-15T03:19:55.935713+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:57.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:56 smithi104 bash[15781]: audit 2024-09-15T03:19:55.941844+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:57.482 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:19:57.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:57 smithi053 bash[15077]: cephadm 2024-09-15T03:19:55.927134+0000 mgr.y (mgr.14150) 132 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:19:57.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:57 smithi053 bash[15077]: cluster 2024-09-15T03:19:55.937613+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:57.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:57 smithi053 bash[15077]: cluster 2024-09-15T03:19:56.929113+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:19:57.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:57 smithi053 bash[21662]: cephadm 2024-09-15T03:19:55.927134+0000 mgr.y (mgr.14150) 132 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:19:57.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:57 smithi053 bash[21662]: cluster 2024-09-15T03:19:55.937613+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:57.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:57 smithi053 bash[21662]: cluster 2024-09-15T03:19:56.929113+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:19:58.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:57 smithi104 bash[15781]: cephadm 2024-09-15T03:19:55.927134+0000 mgr.y (mgr.14150) 132 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:19:58.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:57 smithi104 bash[15781]: cluster 2024-09-15T03:19:55.937613+0000 mgr.y (mgr.14150) 133 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:58.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:57 smithi104 bash[15781]: cluster 2024-09-15T03:19:56.929113+0000 mon.a (mon.0) 371 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: cluster 2024-09-15T03:19:57.938100+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: audit 2024-09-15T03:19:58.465152+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: audit 2024-09-15T03:19:58.470083+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: audit 2024-09-15T03:19:58.472985+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: audit 2024-09-15T03:19:58.476670+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: audit 2024-09-15T03:19:58.476879+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: audit 2024-09-15T03:19:58.478211+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: cluster 2024-09-15T03:19:58.479928+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: audit 2024-09-15T03:19:58.484354+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: cluster 2024-09-15T03:19:58.782099+0000 mon.a (mon.0) 379 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:19:59.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:19:59 smithi104 bash[15781]: cluster 2024-09-15T03:19:58.782152+0000 mon.a (mon.0) 380 : cluster [INF] Cluster is now healthy 2024-09-15T03:19:59.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: cluster 2024-09-15T03:19:57.938100+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:59.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: audit 2024-09-15T03:19:58.465152+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: audit 2024-09-15T03:19:58.470083+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: audit 2024-09-15T03:19:58.472985+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: audit 2024-09-15T03:19:58.476670+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: audit 2024-09-15T03:19:58.476879+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: audit 2024-09-15T03:19:58.478211+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: cluster 2024-09-15T03:19:58.479928+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: audit 2024-09-15T03:19:58.484354+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: cluster 2024-09-15T03:19:58.782099+0000 mon.a (mon.0) 379 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[21662]: cluster 2024-09-15T03:19:58.782152+0000 mon.a (mon.0) 380 : cluster [INF] Cluster is now healthy 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: cluster 2024-09-15T03:19:57.938100+0000 mgr.y (mgr.14150) 134 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:59.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: audit 2024-09-15T03:19:58.465152+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: audit 2024-09-15T03:19:58.470083+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: audit 2024-09-15T03:19:58.472985+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: audit 2024-09-15T03:19:58.476670+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: audit 2024-09-15T03:19:58.476879+0000 mon.a (mon.0) 376 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: audit 2024-09-15T03:19:58.478211+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: cluster 2024-09-15T03:19:58.479928+0000 mgr.y (mgr.14150) 135 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: audit 2024-09-15T03:19:58.484354+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: cluster 2024-09-15T03:19:58.782099+0000 mon.a (mon.0) 379 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:19:59.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:19:59 smithi053 bash[15077]: cluster 2024-09-15T03:19:58.782152+0000 mon.a (mon.0) 380 : cluster [INF] Cluster is now healthy 2024-09-15T03:20:00.731 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:00 smithi104 bash[15781]: cluster 2024-09-15T03:20:00.000181+0000 mon.a (mon.0) 381 : cluster [INF] overall HEALTH_OK 2024-09-15T03:20:00.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:00 smithi053 bash[15077]: cluster 2024-09-15T03:20:00.000181+0000 mon.a (mon.0) 381 : cluster [INF] overall HEALTH_OK 2024-09-15T03:20:00.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:00 smithi053 bash[21662]: cluster 2024-09-15T03:20:00.000181+0000 mon.a (mon.0) 381 : cluster [INF] overall HEALTH_OK 2024-09-15T03:20:01.050 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/nvme3n1 2024-09-15T03:20:01.050 INFO:teuthology.orchestra.run.smithi053.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:20:01.057 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme3n1 bs=1M count=10 conv=fsync 2024-09-15T03:20:01.077 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2024-09-15T03:20:01.077 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2024-09-15T03:20:01.077 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0156668 s, 669 MB/s 2024-09-15T03:20:01.078 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2024-09-15T03:20:01.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:01 smithi053 bash[15077]: cluster 2024-09-15T03:20:00.480319+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:01.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:01 smithi053 bash[21662]: cluster 2024-09-15T03:20:00.480319+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:01.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:01 smithi104 bash[15781]: cluster 2024-09-15T03:20:00.480319+0000 mgr.y (mgr.14150) 136 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:01.781 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi053:/dev/nvme3n1 2024-09-15T03:20:03.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[21662]: audit 2024-09-15T03:20:02.180741+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[21662]: audit 2024-09-15T03:20:02.185671+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[21662]: audit 2024-09-15T03:20:02.192556+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[21662]: cluster 2024-09-15T03:20:02.480820+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:03.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[15077]: audit 2024-09-15T03:20:02.180741+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[15077]: audit 2024-09-15T03:20:02.185671+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[15077]: audit 2024-09-15T03:20:02.192556+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:03 smithi053 bash[15077]: cluster 2024-09-15T03:20:02.480820+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:03.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:03 smithi104 bash[15781]: audit 2024-09-15T03:20:02.180741+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:03 smithi104 bash[15781]: audit 2024-09-15T03:20:02.185671+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:03 smithi104 bash[15781]: audit 2024-09-15T03:20:02.192556+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:03.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:03 smithi104 bash[15781]: cluster 2024-09-15T03:20:02.480820+0000 mgr.y (mgr.14150) 137 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:05.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:05 smithi053 bash[15077]: cluster 2024-09-15T03:20:04.481306+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:05.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:05 smithi053 bash[21662]: cluster 2024-09-15T03:20:04.481306+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:05.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:05 smithi104 bash[15781]: cluster 2024-09-15T03:20:04.481306+0000 mgr.y (mgr.14150) 138 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:06.525 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:20:07.791 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:07 smithi053 bash[15077]: cluster 2024-09-15T03:20:06.481788+0000 mgr.y (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:07.792 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:07 smithi053 bash[21662]: cluster 2024-09-15T03:20:06.481788+0000 mgr.y (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:07.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:07 smithi104 bash[15781]: cluster 2024-09-15T03:20:06.481788+0000 mgr.y (mgr.14150) 139 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:09.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:09 smithi053 bash[15077]: cluster 2024-09-15T03:20:08.482270+0000 mgr.y (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:09.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:09 smithi053 bash[21662]: cluster 2024-09-15T03:20:08.482270+0000 mgr.y (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:09.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:09 smithi104 bash[15781]: cluster 2024-09-15T03:20:08.482270+0000 mgr.y (mgr.14150) 140 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:10.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:10 smithi053 bash[15077]: audit 2024-09-15T03:20:09.804021+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:20:10.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:10 smithi053 bash[15077]: audit 2024-09-15T03:20:09.809454+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:20:10.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:10 smithi053 bash[15077]: audit 2024-09-15T03:20:09.810672+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:10.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:10 smithi053 bash[21662]: audit 2024-09-15T03:20:09.804021+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:20:10.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:10 smithi053 bash[21662]: audit 2024-09-15T03:20:09.809454+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:20:10.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:10 smithi053 bash[21662]: audit 2024-09-15T03:20:09.810672+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:10.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:10 smithi104 bash[15781]: audit 2024-09-15T03:20:09.804021+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:20:10.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:10 smithi104 bash[15781]: audit 2024-09-15T03:20:09.809454+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:20:10.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:10 smithi104 bash[15781]: audit 2024-09-15T03:20:09.810672+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:11.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:11 smithi053 bash[15077]: audit 2024-09-15T03:20:09.797918+0000 mgr.y (mgr.14150) 141 : audit [DBG] from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:20:11.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:11 smithi053 bash[15077]: cluster 2024-09-15T03:20:10.482755+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:11.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:11 smithi053 bash[21662]: audit 2024-09-15T03:20:09.797918+0000 mgr.y (mgr.14150) 141 : audit [DBG] from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:20:11.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:11 smithi053 bash[21662]: cluster 2024-09-15T03:20:10.482755+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:11.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:11 smithi104 bash[15781]: audit 2024-09-15T03:20:09.797918+0000 mgr.y (mgr.14150) 141 : audit [DBG] from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:20:11.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:11 smithi104 bash[15781]: cluster 2024-09-15T03:20:10.482755+0000 mgr.y (mgr.14150) 142 : cluster [DBG] pgmap v94: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:13.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:13 smithi053 bash[15077]: cluster 2024-09-15T03:20:12.483202+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:13.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:13 smithi053 bash[21662]: cluster 2024-09-15T03:20:12.483202+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:13.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:13 smithi104 bash[15781]: cluster 2024-09-15T03:20:12.483202+0000 mgr.y (mgr.14150) 143 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:15.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:15 smithi053 bash[21662]: cluster 2024-09-15T03:20:14.483649+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:15.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:15 smithi053 bash[15077]: cluster 2024-09-15T03:20:14.483649+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:15.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:15 smithi104 bash[15781]: cluster 2024-09-15T03:20:14.483649+0000 mgr.y (mgr.14150) 144 : cluster [DBG] pgmap v96: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:17.798 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:17 smithi053 bash[15077]: cluster 2024-09-15T03:20:16.484078+0000 mgr.y (mgr.14150) 145 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:17.798 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:17 smithi053 bash[21662]: cluster 2024-09-15T03:20:16.484078+0000 mgr.y (mgr.14150) 145 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:17.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:17 smithi104 bash[15781]: cluster 2024-09-15T03:20:16.484078+0000 mgr.y (mgr.14150) 145 : cluster [DBG] pgmap v97: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:19.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:19 smithi104 bash[15781]: audit 2024-09-15T03:20:18.022427+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:19 smithi104 bash[15781]: audit 2024-09-15T03:20:18.028059+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:19 smithi104 bash[15781]: audit 2024-09-15T03:20:18.033488+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.299 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:19 smithi104 bash[15781]: cluster 2024-09-15T03:20:18.484644+0000 mgr.y (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[15077]: audit 2024-09-15T03:20:18.022427+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[15077]: audit 2024-09-15T03:20:18.028059+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[15077]: audit 2024-09-15T03:20:18.033488+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[15077]: cluster 2024-09-15T03:20:18.484644+0000 mgr.y (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:19.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[21662]: audit 2024-09-15T03:20:18.022427+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[21662]: audit 2024-09-15T03:20:18.028059+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[21662]: audit 2024-09-15T03:20:18.033488+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:19.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:19 smithi053 bash[21662]: cluster 2024-09-15T03:20:18.484644+0000 mgr.y (mgr.14150) 146 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:20.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[15077]: audit 2024-09-15T03:20:19.373264+0000 mon.a (mon.0) 391 : audit [INF] from='client.? 172.21.15.53:0/3605530664' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "404e0f2b-d138-4c1a-a29c-9b33c3d56c0f"}]: dispatch 2024-09-15T03:20:20.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[15077]: audit 2024-09-15T03:20:19.378698+0000 mon.a (mon.0) 392 : audit [INF] from='client.? 172.21.15.53:0/3605530664' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "404e0f2b-d138-4c1a-a29c-9b33c3d56c0f"}]': finished 2024-09-15T03:20:20.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[15077]: cluster 2024-09-15T03:20:19.378760+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-15T03:20:20.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[15077]: audit 2024-09-15T03:20:19.378993+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:20.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[21662]: audit 2024-09-15T03:20:19.373264+0000 mon.a (mon.0) 391 : audit [INF] from='client.? 172.21.15.53:0/3605530664' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "404e0f2b-d138-4c1a-a29c-9b33c3d56c0f"}]: dispatch 2024-09-15T03:20:20.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[21662]: audit 2024-09-15T03:20:19.378698+0000 mon.a (mon.0) 392 : audit [INF] from='client.? 172.21.15.53:0/3605530664' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "404e0f2b-d138-4c1a-a29c-9b33c3d56c0f"}]': finished 2024-09-15T03:20:20.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[21662]: cluster 2024-09-15T03:20:19.378760+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-15T03:20:20.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:20 smithi053 bash[21662]: audit 2024-09-15T03:20:19.378993+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:20.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:20 smithi104 bash[15781]: audit 2024-09-15T03:20:19.373264+0000 mon.a (mon.0) 391 : audit [INF] from='client.? 172.21.15.53:0/3605530664' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "404e0f2b-d138-4c1a-a29c-9b33c3d56c0f"}]: dispatch 2024-09-15T03:20:20.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:20 smithi104 bash[15781]: audit 2024-09-15T03:20:19.378698+0000 mon.a (mon.0) 392 : audit [INF] from='client.? 172.21.15.53:0/3605530664' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "404e0f2b-d138-4c1a-a29c-9b33c3d56c0f"}]': finished 2024-09-15T03:20:20.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:20 smithi104 bash[15781]: cluster 2024-09-15T03:20:19.378760+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2024-09-15T03:20:20.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:20 smithi104 bash[15781]: audit 2024-09-15T03:20:19.378993+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:21.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:21 smithi053 bash[15077]: cluster 2024-09-15T03:20:20.485238+0000 mgr.y (mgr.14150) 147 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:21.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:21 smithi053 bash[15077]: audit 2024-09-15T03:20:20.986837+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.53:0/2811461739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:20:21.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:21 smithi053 bash[21662]: cluster 2024-09-15T03:20:20.485238+0000 mgr.y (mgr.14150) 147 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:21.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:21 smithi053 bash[21662]: audit 2024-09-15T03:20:20.986837+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.53:0/2811461739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:20:21.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:21 smithi104 bash[15781]: cluster 2024-09-15T03:20:20.485238+0000 mgr.y (mgr.14150) 147 : cluster [DBG] pgmap v100: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:21.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:21 smithi104 bash[15781]: audit 2024-09-15T03:20:20.986837+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.53:0/2811461739' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:20:23.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[15077]: audit 2024-09-15T03:20:22.370410+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[15077]: audit 2024-09-15T03:20:22.377117+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[15077]: audit 2024-09-15T03:20:22.384247+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[15077]: cluster 2024-09-15T03:20:22.485762+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:23.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[21662]: audit 2024-09-15T03:20:22.370410+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[21662]: audit 2024-09-15T03:20:22.377117+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[21662]: audit 2024-09-15T03:20:22.384247+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:23 smithi053 bash[21662]: cluster 2024-09-15T03:20:22.485762+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:23.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:23 smithi104 bash[15781]: audit 2024-09-15T03:20:22.370410+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:23 smithi104 bash[15781]: audit 2024-09-15T03:20:22.377117+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:23 smithi104 bash[15781]: audit 2024-09-15T03:20:22.384247+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:23.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:23 smithi104 bash[15781]: cluster 2024-09-15T03:20:22.485762+0000 mgr.y (mgr.14150) 148 : cluster [DBG] pgmap v101: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:25.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:25 smithi053 bash[15077]: cluster 2024-09-15T03:20:24.486213+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:25.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:25 smithi053 bash[21662]: cluster 2024-09-15T03:20:24.486213+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:25.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:25 smithi104 bash[15781]: cluster 2024-09-15T03:20:24.486213+0000 mgr.y (mgr.14150) 149 : cluster [DBG] pgmap v102: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:27.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:27 smithi053 bash[15077]: cluster 2024-09-15T03:20:26.486682+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:27.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:27 smithi053 bash[21662]: cluster 2024-09-15T03:20:26.486682+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:27.981 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:27 smithi104 bash[15781]: cluster 2024-09-15T03:20:26.486682+0000 mgr.y (mgr.14150) 150 : cluster [DBG] pgmap v103: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:29.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:29 smithi053 bash[15077]: cluster 2024-09-15T03:20:28.487217+0000 mgr.y (mgr.14150) 151 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:29.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:29 smithi053 bash[21662]: cluster 2024-09-15T03:20:28.487217+0000 mgr.y (mgr.14150) 151 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:29.981 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:29 smithi104 bash[15781]: cluster 2024-09-15T03:20:28.487217+0000 mgr.y (mgr.14150) 151 : cluster [DBG] pgmap v104: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:31.869 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:31 smithi053 bash[15077]: cluster 2024-09-15T03:20:30.487666+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:31.869 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:31 smithi053 bash[21662]: cluster 2024-09-15T03:20:30.487666+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:31.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:31 smithi104 bash[15781]: cluster 2024-09-15T03:20:30.487666+0000 mgr.y (mgr.14150) 152 : cluster [DBG] pgmap v105: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:33.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:33 smithi053 bash[15077]: cluster 2024-09-15T03:20:32.487987+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:33.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:33 smithi053 bash[15077]: audit 2024-09-15T03:20:33.446591+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T03:20:33.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:33 smithi053 bash[15077]: audit 2024-09-15T03:20:33.447658+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:33.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:33 smithi053 bash[21662]: cluster 2024-09-15T03:20:32.487987+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:33.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:33 smithi053 bash[21662]: audit 2024-09-15T03:20:33.446591+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T03:20:33.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:33 smithi053 bash[21662]: audit 2024-09-15T03:20:33.447658+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:33.981 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:33 smithi104 bash[15781]: cluster 2024-09-15T03:20:32.487987+0000 mgr.y (mgr.14150) 153 : cluster [DBG] pgmap v106: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:33.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:33 smithi104 bash[15781]: audit 2024-09-15T03:20:33.446591+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T03:20:33.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:33 smithi104 bash[15781]: audit 2024-09-15T03:20:33.447658+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:34.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:34 smithi053 bash[15077]: cephadm 2024-09-15T03:20:33.448517+0000 mgr.y (mgr.14150) 154 : cephadm [INF] Deploying daemon osd.1 on smithi053 2024-09-15T03:20:34.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:34 smithi053 bash[21662]: cephadm 2024-09-15T03:20:33.448517+0000 mgr.y (mgr.14150) 154 : cephadm [INF] Deploying daemon osd.1 on smithi053 2024-09-15T03:20:34.981 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:34 smithi104 bash[15781]: cephadm 2024-09-15T03:20:33.448517+0000 mgr.y (mgr.14150) 154 : cephadm [INF] Deploying daemon osd.1 on smithi053 2024-09-15T03:20:35.637 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:35 smithi053 bash[21662]: cluster 2024-09-15T03:20:34.488563+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:35.637 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:35 smithi053 bash[15077]: cluster 2024-09-15T03:20:34.488563+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:35.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:35 smithi104 bash[15781]: cluster 2024-09-15T03:20:34.488563+0000 mgr.y (mgr.14150) 155 : cluster [DBG] pgmap v107: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:37.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:37 smithi053 bash[15077]: cluster 2024-09-15T03:20:36.489009+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:37.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:37 smithi053 bash[21662]: cluster 2024-09-15T03:20:36.489009+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:37.981 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:37 smithi104 bash[15781]: cluster 2024-09-15T03:20:36.489009+0000 mgr.y (mgr.14150) 156 : cluster [DBG] pgmap v108: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:39.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.215282+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.221524+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.228514+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: cluster 2024-09-15T03:20:38.489457+0000 mgr.y (mgr.14150) 157 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:39.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.811346+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:20:39.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.816762+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.817314+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.819172+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.822811+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[15077]: audit 2024-09-15T03:20:38.827825+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.215282+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.221524+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.228514+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: cluster 2024-09-15T03:20:38.489457+0000 mgr.y (mgr.14150) 157 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.811346+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.816762+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.817314+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.819172+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:20:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.822811+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:39 smithi053 bash[21662]: audit 2024-09-15T03:20:38.827825+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.215282+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.221524+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.228514+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: cluster 2024-09-15T03:20:38.489457+0000 mgr.y (mgr.14150) 157 : cluster [DBG] pgmap v109: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.811346+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.816762+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.817314+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.819172+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.822811+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:39.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:39 smithi104 bash[15781]: audit 2024-09-15T03:20:38.827825+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.779 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[21662]: cluster 2024-09-15T03:20:40.489783+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:41.780 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[21662]: audit 2024-09-15T03:20:41.282151+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.780 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[21662]: audit 2024-09-15T03:20:41.287360+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.780 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[21662]: audit 2024-09-15T03:20:41.292874+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.780 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[15077]: cluster 2024-09-15T03:20:40.489783+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:41.780 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[15077]: audit 2024-09-15T03:20:41.282151+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.780 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[15077]: audit 2024-09-15T03:20:41.287360+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.780 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:41 smithi053 bash[15077]: audit 2024-09-15T03:20:41.292874+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:41 smithi104 bash[15781]: cluster 2024-09-15T03:20:40.489783+0000 mgr.y (mgr.14150) 158 : cluster [DBG] pgmap v110: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:41 smithi104 bash[15781]: audit 2024-09-15T03:20:41.282151+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:41 smithi104 bash[15781]: audit 2024-09-15T03:20:41.287360+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:41 smithi104 bash[15781]: audit 2024-09-15T03:20:41.292874+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[21662]: cluster 2024-09-15T03:20:42.490237+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:43.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[21662]: audit 2024-09-15T03:20:42.555704+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[21662]: audit 2024-09-15T03:20:42.560499+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[21662]: audit 2024-09-15T03:20:42.567226+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[15077]: cluster 2024-09-15T03:20:42.490237+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:43.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[15077]: audit 2024-09-15T03:20:42.555704+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[15077]: audit 2024-09-15T03:20:42.560499+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:43 smithi053 bash[15077]: audit 2024-09-15T03:20:42.567226+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:43 smithi104 bash[15781]: cluster 2024-09-15T03:20:42.490237+0000 mgr.y (mgr.14150) 159 : cluster [DBG] pgmap v111: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:43.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:43 smithi104 bash[15781]: audit 2024-09-15T03:20:42.555704+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:43 smithi104 bash[15781]: audit 2024-09-15T03:20:42.560499+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:43.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:43 smithi104 bash[15781]: audit 2024-09-15T03:20:42.567226+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:45.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:45 smithi053 bash[15077]: cluster 2024-09-15T03:20:44.490639+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:45.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:45 smithi053 bash[21662]: cluster 2024-09-15T03:20:44.490639+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:45.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:45 smithi104 bash[15781]: cluster 2024-09-15T03:20:44.490639+0000 mgr.y (mgr.14150) 160 : cluster [DBG] pgmap v112: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:47.452 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 1 on host 'smithi053' 2024-09-15T03:20:47.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: cluster 2024-09-15T03:20:46.491079+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:47.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.285972+0000 mon.a (mon.0) 415 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T03:20:47.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.437333+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.442749+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.443002+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.445867+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.450019+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.457518+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.459320+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.460536+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[15077]: audit 2024-09-15T03:20:47.468273+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: cluster 2024-09-15T03:20:46.491079+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.285972+0000 mon.a (mon.0) 415 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T03:20:47.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.437333+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.442749+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.443002+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.445867+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.450019+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.457518+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.459320+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.460536+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:20:47.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:47 smithi053 bash[21662]: audit 2024-09-15T03:20:47.468273+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: cluster 2024-09-15T03:20:46.491079+0000 mgr.y (mgr.14150) 161 : cluster [DBG] pgmap v113: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.285972+0000 mon.a (mon.0) 415 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.437333+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.442749+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.443002+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.445867+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.450019+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.457518+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:47.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.459320+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:20:47.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.460536+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:20:47.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:47 smithi104 bash[15781]: audit 2024-09-15T03:20:47.468273+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:20:48.129 DEBUG:teuthology.orchestra.run.smithi053:osd.1> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T03:20:48.132 INFO:tasks.cephadm:Deploying osd.2 on smithi053 with /dev/nvme2n1... 2024-09-15T03:20:48.132 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme2n1 2024-09-15T03:20:48.247 INFO:journalctl@ceph.osd.1.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:20:48.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[21662]: cephadm 2024-09-15T03:20:47.451465+0000 mgr.y (mgr.14150) 162 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 7610M 2024-09-15T03:20:48.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[21662]: audit 2024-09-15T03:20:47.567898+0000 mon.a (mon.0) 425 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T03:20:48.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[21662]: cluster 2024-09-15T03:20:47.568001+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-15T03:20:48.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[21662]: audit 2024-09-15T03:20:47.568693+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:48.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[21662]: audit 2024-09-15T03:20:47.569299+0000 mon.a (mon.0) 428 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:20:48.941 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[30540]: debug 2024-09-15T03:20:48.575+0000 7f1ec553d640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T03:20:48.941 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[30540]: debug 2024-09-15T03:20:48.583+0000 7f1ec0b75640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T03:20:48.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[15077]: cephadm 2024-09-15T03:20:47.451465+0000 mgr.y (mgr.14150) 162 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 7610M 2024-09-15T03:20:48.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[15077]: audit 2024-09-15T03:20:47.567898+0000 mon.a (mon.0) 425 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T03:20:48.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[15077]: cluster 2024-09-15T03:20:47.568001+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-15T03:20:48.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[15077]: audit 2024-09-15T03:20:47.568693+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:48.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:48 smithi053 bash[15077]: audit 2024-09-15T03:20:47.569299+0000 mon.a (mon.0) 428 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:20:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:48 smithi104 bash[15781]: cephadm 2024-09-15T03:20:47.451465+0000 mgr.y (mgr.14150) 162 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 7610M 2024-09-15T03:20:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:48 smithi104 bash[15781]: audit 2024-09-15T03:20:47.567898+0000 mon.a (mon.0) 425 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T03:20:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:48 smithi104 bash[15781]: cluster 2024-09-15T03:20:47.568001+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-09-15T03:20:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:48 smithi104 bash[15781]: audit 2024-09-15T03:20:47.568693+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:48 smithi104 bash[15781]: audit 2024-09-15T03:20:47.569299+0000 mon.a (mon.0) 428 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:20:49.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[21662]: cluster 2024-09-15T03:20:48.491548+0000 mgr.y (mgr.14150) 163 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:49.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[21662]: audit 2024-09-15T03:20:48.570180+0000 mon.a (mon.0) 429 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:20:49.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[21662]: cluster 2024-09-15T03:20:48.570281+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-15T03:20:49.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[21662]: audit 2024-09-15T03:20:48.570545+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:49.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[21662]: audit 2024-09-15T03:20:48.581407+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:49.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[15077]: cluster 2024-09-15T03:20:48.491548+0000 mgr.y (mgr.14150) 163 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:49.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[15077]: audit 2024-09-15T03:20:48.570180+0000 mon.a (mon.0) 429 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:20:49.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[15077]: cluster 2024-09-15T03:20:48.570281+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-15T03:20:49.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[15077]: audit 2024-09-15T03:20:48.570545+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:49.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:49 smithi053 bash[15077]: audit 2024-09-15T03:20:48.581407+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:49.981 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:49 smithi104 bash[15781]: cluster 2024-09-15T03:20:48.491548+0000 mgr.y (mgr.14150) 163 : cluster [DBG] pgmap v115: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:49.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:49 smithi104 bash[15781]: audit 2024-09-15T03:20:48.570180+0000 mon.a (mon.0) 429 : audit [INF] from='osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:20:49.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:49 smithi104 bash[15781]: cluster 2024-09-15T03:20:48.570281+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-09-15T03:20:49.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:49 smithi104 bash[15781]: audit 2024-09-15T03:20:48.570545+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:49.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:49 smithi104 bash[15781]: audit 2024-09-15T03:20:48.581407+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[21662]: cluster 2024-09-15T03:20:48.305043+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:20:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[21662]: cluster 2024-09-15T03:20:48.305174+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:20:50.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[21662]: audit 2024-09-15T03:20:49.577243+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:50.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[21662]: cluster 2024-09-15T03:20:49.590158+0000 mon.a (mon.0) 434 : cluster [INF] osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182] boot 2024-09-15T03:20:50.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[21662]: cluster 2024-09-15T03:20:49.590211+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-15T03:20:50.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[21662]: audit 2024-09-15T03:20:49.590585+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[15077]: cluster 2024-09-15T03:20:48.305043+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:20:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[15077]: cluster 2024-09-15T03:20:48.305174+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:20:50.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[15077]: audit 2024-09-15T03:20:49.577243+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:50.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[15077]: cluster 2024-09-15T03:20:49.590158+0000 mon.a (mon.0) 434 : cluster [INF] osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182] boot 2024-09-15T03:20:50.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[15077]: cluster 2024-09-15T03:20:49.590211+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-15T03:20:50.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:50 smithi053 bash[15077]: audit 2024-09-15T03:20:49.590585+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:50 smithi104 bash[15781]: cluster 2024-09-15T03:20:48.305043+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:20:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:50 smithi104 bash[15781]: cluster 2024-09-15T03:20:48.305174+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:20:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:50 smithi104 bash[15781]: audit 2024-09-15T03:20:49.577243+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:50 smithi104 bash[15781]: cluster 2024-09-15T03:20:49.590158+0000 mon.a (mon.0) 434 : cluster [INF] osd.1 [v2:172.21.15.53:6810/2958260182,v1:172.21.15.53:6811/2958260182] boot 2024-09-15T03:20:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:50 smithi104 bash[15781]: cluster 2024-09-15T03:20:49.590211+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2024-09-15T03:20:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:50 smithi104 bash[15781]: audit 2024-09-15T03:20:49.590585+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:20:51.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:51 smithi053 bash[15077]: cluster 2024-09-15T03:20:50.492049+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:51.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:51 smithi053 bash[15077]: cluster 2024-09-15T03:20:50.594445+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-15T03:20:51.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:51 smithi053 bash[21662]: cluster 2024-09-15T03:20:50.492049+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:51 smithi053 bash[21662]: cluster 2024-09-15T03:20:50.594445+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-15T03:20:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:51 smithi104 bash[15781]: cluster 2024-09-15T03:20:50.492049+0000 mgr.y (mgr.14150) 164 : cluster [DBG] pgmap v118: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-15T03:20:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:51 smithi104 bash[15781]: cluster 2024-09-15T03:20:50.594445+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-09-15T03:20:52.930 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:20:53.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:53 smithi053 bash[15077]: cluster 2024-09-15T03:20:52.492612+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:53.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:53 smithi053 bash[21662]: cluster 2024-09-15T03:20:52.492612+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:53.981 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:53 smithi104 bash[15781]: cluster 2024-09-15T03:20:52.492612+0000 mgr.y (mgr.14150) 165 : cluster [DBG] pgmap v120: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:55 smithi053 bash[15077]: cluster 2024-09-15T03:20:54.493157+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:55.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:55 smithi053 bash[21662]: cluster 2024-09-15T03:20:54.493157+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:55.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:55 smithi104 bash[15781]: cluster 2024-09-15T03:20:54.493157+0000 mgr.y (mgr.14150) 166 : cluster [DBG] pgmap v121: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:56.279 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/nvme2n1 2024-09-15T03:20:56.279 INFO:teuthology.orchestra.run.smithi053.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:20:56.286 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme2n1 bs=1M count=10 conv=fsync 2024-09-15T03:20:56.304 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2024-09-15T03:20:56.305 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2024-09-15T03:20:56.305 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.014944 s, 702 MB/s 2024-09-15T03:20:56.305 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2024-09-15T03:20:57.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi053:/dev/nvme2n1 2024-09-15T03:20:57.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:57 smithi053 bash[15077]: cluster 2024-09-15T03:20:56.493778+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:57.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:57 smithi053 bash[21662]: cluster 2024-09-15T03:20:56.493778+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:57.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:57 smithi104 bash[15781]: cluster 2024-09-15T03:20:56.493778+0000 mgr.y (mgr.14150) 167 : cluster [DBG] pgmap v122: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:59.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:20:59 smithi104 bash[15781]: cluster 2024-09-15T03:20:58.494263+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:59.869 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:20:59 smithi053 bash[15077]: cluster 2024-09-15T03:20:58.494263+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:20:59.869 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:20:59 smithi053 bash[21662]: cluster 2024-09-15T03:20:58.494263+0000 mgr.y (mgr.14150) 168 : cluster [DBG] pgmap v123: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[21662]: cluster 2024-09-15T03:21:00.494806+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[21662]: audit 2024-09-15T03:21:01.483048+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[21662]: audit 2024-09-15T03:21:01.489227+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[21662]: audit 2024-09-15T03:21:01.495604+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[15077]: cluster 2024-09-15T03:21:00.494806+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[15077]: audit 2024-09-15T03:21:01.483048+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[15077]: audit 2024-09-15T03:21:01.489227+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:01 smithi053 bash[15077]: audit 2024-09-15T03:21:01.495604+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:01 smithi104 bash[15781]: cluster 2024-09-15T03:21:00.494806+0000 mgr.y (mgr.14150) 169 : cluster [DBG] pgmap v124: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:01 smithi104 bash[15781]: audit 2024-09-15T03:21:01.483048+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:01 smithi104 bash[15781]: audit 2024-09-15T03:21:01.489227+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:01 smithi104 bash[15781]: audit 2024-09-15T03:21:01.495604+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:02.139 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:21:02.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:02 smithi053 bash[15077]: cephadm 2024-09-15T03:21:01.491581+0000 mgr.y (mgr.14150) 170 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:21:02.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:02 smithi053 bash[21662]: cephadm 2024-09-15T03:21:01.491581+0000 mgr.y (mgr.14150) 170 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:21:02.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:02 smithi104 bash[15781]: cephadm 2024-09-15T03:21:01.491581+0000 mgr.y (mgr.14150) 170 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:21:03.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[15077]: cluster 2024-09-15T03:21:02.495294+0000 mgr.y (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:03.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[15077]: audit 2024-09-15T03:21:02.757128+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:03.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[15077]: audit 2024-09-15T03:21:02.763637+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:03.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[15077]: audit 2024-09-15T03:21:02.771107+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:03.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[21662]: cluster 2024-09-15T03:21:02.495294+0000 mgr.y (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:03.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[21662]: audit 2024-09-15T03:21:02.757128+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:03.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[21662]: audit 2024-09-15T03:21:02.763637+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:03.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:03 smithi053 bash[21662]: audit 2024-09-15T03:21:02.771107+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:04.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:03 smithi104 bash[15781]: cluster 2024-09-15T03:21:02.495294+0000 mgr.y (mgr.14150) 171 : cluster [DBG] pgmap v125: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:04.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:03 smithi104 bash[15781]: audit 2024-09-15T03:21:02.757128+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:04.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:03 smithi104 bash[15781]: audit 2024-09-15T03:21:02.763637+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:04.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:03 smithi104 bash[15781]: audit 2024-09-15T03:21:02.771107+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[15077]: cluster 2024-09-15T03:21:04.495818+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:06.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[15077]: audit 2024-09-15T03:21:05.149278+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[15077]: audit 2024-09-15T03:21:05.155728+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[15077]: audit 2024-09-15T03:21:05.162016+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[15077]: audit 2024-09-15T03:21:05.449910+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[15077]: audit 2024-09-15T03:21:05.455299+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[15077]: audit 2024-09-15T03:21:05.456841+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[21662]: cluster 2024-09-15T03:21:04.495818+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[21662]: audit 2024-09-15T03:21:05.149278+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[21662]: audit 2024-09-15T03:21:05.155728+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[21662]: audit 2024-09-15T03:21:05.162016+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[21662]: audit 2024-09-15T03:21:05.449910+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[21662]: audit 2024-09-15T03:21:05.455299+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:21:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:05 smithi053 bash[21662]: audit 2024-09-15T03:21:05.456841+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:05 smithi104 bash[15781]: cluster 2024-09-15T03:21:04.495818+0000 mgr.y (mgr.14150) 172 : cluster [DBG] pgmap v126: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:05 smithi104 bash[15781]: audit 2024-09-15T03:21:05.149278+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:05 smithi104 bash[15781]: audit 2024-09-15T03:21:05.155728+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:05 smithi104 bash[15781]: audit 2024-09-15T03:21:05.162016+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:05 smithi104 bash[15781]: audit 2024-09-15T03:21:05.449910+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:21:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:05 smithi104 bash[15781]: audit 2024-09-15T03:21:05.455299+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:21:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:05 smithi104 bash[15781]: audit 2024-09-15T03:21:05.456841+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:07.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:06 smithi053 bash[15077]: audit 2024-09-15T03:21:05.447037+0000 mgr.y (mgr.14150) 173 : audit [DBG] from='client.24176 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:21:07.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:06 smithi053 bash[21662]: audit 2024-09-15T03:21:05.447037+0000 mgr.y (mgr.14150) 173 : audit [DBG] from='client.24176 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:21:07.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:06 smithi104 bash[15781]: audit 2024-09-15T03:21:05.447037+0000 mgr.y (mgr.14150) 173 : audit [DBG] from='client.24176 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:21:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:07 smithi053 bash[15077]: cluster 2024-09-15T03:21:06.496336+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:08.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:07 smithi053 bash[21662]: cluster 2024-09-15T03:21:06.496336+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:08.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:07 smithi104 bash[15781]: cluster 2024-09-15T03:21:06.496336+0000 mgr.y (mgr.14150) 174 : cluster [DBG] pgmap v127: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:10.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:09 smithi053 bash[15077]: cluster 2024-09-15T03:21:08.496762+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:10.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:09 smithi053 bash[21662]: cluster 2024-09-15T03:21:08.496762+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:10.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:09 smithi104 bash[15781]: cluster 2024-09-15T03:21:08.496762+0000 mgr.y (mgr.14150) 175 : cluster [DBG] pgmap v128: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:11.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:11 smithi053 bash[21662]: cluster 2024-09-15T03:21:10.497235+0000 mgr.y (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:11.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:11 smithi053 bash[15077]: cluster 2024-09-15T03:21:10.497235+0000 mgr.y (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:12.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:11 smithi104 bash[15781]: cluster 2024-09-15T03:21:10.497235+0000 mgr.y (mgr.14150) 176 : cluster [DBG] pgmap v129: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:14.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:13 smithi053 bash[15077]: cluster 2024-09-15T03:21:12.497737+0000 mgr.y (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:14.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:13 smithi053 bash[21662]: cluster 2024-09-15T03:21:12.497737+0000 mgr.y (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:14.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:13 smithi104 bash[15781]: cluster 2024-09-15T03:21:12.497737+0000 mgr.y (mgr.14150) 177 : cluster [DBG] pgmap v130: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:15.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[15077]: audit 2024-09-15T03:21:13.988450+0000 mon.a (mon.0) 450 : audit [INF] from='client.? 172.21.15.53:0/3450590853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46f21d02-74d9-4af2-9404-bd0388c25103"}]: dispatch 2024-09-15T03:21:15.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[15077]: audit 2024-09-15T03:21:13.993995+0000 mon.a (mon.0) 451 : audit [INF] from='client.? 172.21.15.53:0/3450590853' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46f21d02-74d9-4af2-9404-bd0388c25103"}]': finished 2024-09-15T03:21:15.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[15077]: cluster 2024-09-15T03:21:13.994037+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-15T03:21:15.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[15077]: audit 2024-09-15T03:21:13.994213+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:15.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[21662]: audit 2024-09-15T03:21:13.988450+0000 mon.a (mon.0) 450 : audit [INF] from='client.? 172.21.15.53:0/3450590853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46f21d02-74d9-4af2-9404-bd0388c25103"}]: dispatch 2024-09-15T03:21:15.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[21662]: audit 2024-09-15T03:21:13.993995+0000 mon.a (mon.0) 451 : audit [INF] from='client.? 172.21.15.53:0/3450590853' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46f21d02-74d9-4af2-9404-bd0388c25103"}]': finished 2024-09-15T03:21:15.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[21662]: cluster 2024-09-15T03:21:13.994037+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-15T03:21:15.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:14 smithi053 bash[21662]: audit 2024-09-15T03:21:13.994213+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:15.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:14 smithi104 bash[15781]: audit 2024-09-15T03:21:13.988450+0000 mon.a (mon.0) 450 : audit [INF] from='client.? 172.21.15.53:0/3450590853' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46f21d02-74d9-4af2-9404-bd0388c25103"}]: dispatch 2024-09-15T03:21:15.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:14 smithi104 bash[15781]: audit 2024-09-15T03:21:13.993995+0000 mon.a (mon.0) 451 : audit [INF] from='client.? 172.21.15.53:0/3450590853' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46f21d02-74d9-4af2-9404-bd0388c25103"}]': finished 2024-09-15T03:21:15.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:14 smithi104 bash[15781]: cluster 2024-09-15T03:21:13.994037+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2024-09-15T03:21:15.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:14 smithi104 bash[15781]: audit 2024-09-15T03:21:13.994213+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:16.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:15 smithi053 bash[15077]: cluster 2024-09-15T03:21:14.498116+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:16.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:15 smithi053 bash[15077]: audit 2024-09-15T03:21:15.533620+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? 172.21.15.53:0/4065544018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:21:16.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:15 smithi053 bash[21662]: cluster 2024-09-15T03:21:14.498116+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:16.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:15 smithi053 bash[21662]: audit 2024-09-15T03:21:15.533620+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? 172.21.15.53:0/4065544018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:21:16.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:15 smithi104 bash[15781]: cluster 2024-09-15T03:21:14.498116+0000 mgr.y (mgr.14150) 178 : cluster [DBG] pgmap v132: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:16.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:15 smithi104 bash[15781]: audit 2024-09-15T03:21:15.533620+0000 mon.c (mon.2) 4 : audit [DBG] from='client.? 172.21.15.53:0/4065544018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:21:18.089 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:17 smithi053 bash[21662]: cluster 2024-09-15T03:21:16.498570+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:18.090 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:17 smithi053 bash[15077]: cluster 2024-09-15T03:21:16.498570+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:18.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:17 smithi104 bash[15781]: cluster 2024-09-15T03:21:16.498570+0000 mgr.y (mgr.14150) 179 : cluster [DBG] pgmap v133: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:20.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:19 smithi053 bash[15077]: cluster 2024-09-15T03:21:18.499080+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:20.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:19 smithi053 bash[21662]: cluster 2024-09-15T03:21:18.499080+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:20.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:19 smithi104 bash[15781]: cluster 2024-09-15T03:21:18.499080+0000 mgr.y (mgr.14150) 180 : cluster [DBG] pgmap v134: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:22.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[15077]: cluster 2024-09-15T03:21:20.499562+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:22.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[15077]: audit 2024-09-15T03:21:21.743210+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[15077]: audit 2024-09-15T03:21:21.749580+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[15077]: audit 2024-09-15T03:21:21.756788+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[21662]: cluster 2024-09-15T03:21:20.499562+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:22.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[21662]: audit 2024-09-15T03:21:21.743210+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[21662]: audit 2024-09-15T03:21:21.749580+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:21 smithi053 bash[21662]: audit 2024-09-15T03:21:21.756788+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:21 smithi104 bash[15781]: cluster 2024-09-15T03:21:20.499562+0000 mgr.y (mgr.14150) 181 : cluster [DBG] pgmap v135: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:22.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:21 smithi104 bash[15781]: audit 2024-09-15T03:21:21.743210+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:21 smithi104 bash[15781]: audit 2024-09-15T03:21:21.749580+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:22.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:21 smithi104 bash[15781]: audit 2024-09-15T03:21:21.756788+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:23.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:22 smithi053 bash[15077]: cephadm 2024-09-15T03:21:21.751864+0000 mgr.y (mgr.14150) 182 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:21:23.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:22 smithi053 bash[21662]: cephadm 2024-09-15T03:21:21.751864+0000 mgr.y (mgr.14150) 182 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:21:23.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:22 smithi104 bash[15781]: cephadm 2024-09-15T03:21:21.751864+0000 mgr.y (mgr.14150) 182 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:21:23.808 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[15077]: cluster 2024-09-15T03:21:22.500062+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:23.808 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[15077]: audit 2024-09-15T03:21:22.998819+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:23.808 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[15077]: audit 2024-09-15T03:21:23.004964+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:23.808 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[15077]: audit 2024-09-15T03:21:23.012201+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:24.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[21662]: cluster 2024-09-15T03:21:22.500062+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:24.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[21662]: audit 2024-09-15T03:21:22.998819+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:24.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[21662]: audit 2024-09-15T03:21:23.004964+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:24.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:23 smithi053 bash[21662]: audit 2024-09-15T03:21:23.012201+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:24.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:23 smithi104 bash[15781]: cluster 2024-09-15T03:21:22.500062+0000 mgr.y (mgr.14150) 183 : cluster [DBG] pgmap v136: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:24.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:23 smithi104 bash[15781]: audit 2024-09-15T03:21:22.998819+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:24.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:23 smithi104 bash[15781]: audit 2024-09-15T03:21:23.004964+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:24.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:23 smithi104 bash[15781]: audit 2024-09-15T03:21:23.012201+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:25.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:24 smithi053 bash[21662]: cluster 2024-09-15T03:21:24.500572+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:25.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:24 smithi053 bash[15077]: cluster 2024-09-15T03:21:24.500572+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:25.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:24 smithi104 bash[15781]: cluster 2024-09-15T03:21:24.500572+0000 mgr.y (mgr.14150) 184 : cluster [DBG] pgmap v137: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:27.835 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:27 smithi053 bash[21662]: cluster 2024-09-15T03:21:26.500881+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:27.835 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:27 smithi053 bash[21662]: audit 2024-09-15T03:21:27.469718+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T03:21:27.835 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:27 smithi053 bash[21662]: audit 2024-09-15T03:21:27.471226+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:27.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:27 smithi053 bash[15077]: cluster 2024-09-15T03:21:26.500881+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:27.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:27 smithi053 bash[15077]: audit 2024-09-15T03:21:27.469718+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T03:21:27.836 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:27 smithi053 bash[15077]: audit 2024-09-15T03:21:27.471226+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:27.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:27 smithi104 bash[15781]: cluster 2024-09-15T03:21:26.500881+0000 mgr.y (mgr.14150) 185 : cluster [DBG] pgmap v138: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:27.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:27 smithi104 bash[15781]: audit 2024-09-15T03:21:27.469718+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T03:21:27.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:27 smithi104 bash[15781]: audit 2024-09-15T03:21:27.471226+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:28.884 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:28 smithi053 bash[15077]: cephadm 2024-09-15T03:21:27.472367+0000 mgr.y (mgr.14150) 186 : cephadm [INF] Deploying daemon osd.2 on smithi053 2024-09-15T03:21:28.884 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:28 smithi053 bash[21662]: cephadm 2024-09-15T03:21:27.472367+0000 mgr.y (mgr.14150) 186 : cephadm [INF] Deploying daemon osd.2 on smithi053 2024-09-15T03:21:28.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:28 smithi104 bash[15781]: cephadm 2024-09-15T03:21:27.472367+0000 mgr.y (mgr.14150) 186 : cephadm [INF] Deploying daemon osd.2 on smithi053 2024-09-15T03:21:29.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:29 smithi053 bash[15077]: cluster 2024-09-15T03:21:28.501219+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:29.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:29 smithi053 bash[21662]: cluster 2024-09-15T03:21:28.501219+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:29.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:29 smithi104 bash[15781]: cluster 2024-09-15T03:21:28.501219+0000 mgr.y (mgr.14150) 187 : cluster [DBG] pgmap v139: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:31.915 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:31 smithi053 bash[15077]: cluster 2024-09-15T03:21:30.501755+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v140: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:31.916 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:31 smithi053 bash[21662]: cluster 2024-09-15T03:21:30.501755+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v140: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:31.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:31 smithi104 bash[15781]: cluster 2024-09-15T03:21:30.501755+0000 mgr.y (mgr.14150) 188 : cluster [DBG] pgmap v140: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:32.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[15077]: audit 2024-09-15T03:21:32.186203+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:32.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[15077]: audit 2024-09-15T03:21:32.192234+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[15077]: audit 2024-09-15T03:21:32.192551+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[15077]: audit 2024-09-15T03:21:32.194500+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[15077]: audit 2024-09-15T03:21:32.198345+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[15077]: audit 2024-09-15T03:21:32.202537+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[21662]: audit 2024-09-15T03:21:32.186203+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[21662]: audit 2024-09-15T03:21:32.192234+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[21662]: audit 2024-09-15T03:21:32.192551+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[21662]: audit 2024-09-15T03:21:32.194500+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[21662]: audit 2024-09-15T03:21:32.198345+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:32 smithi053 bash[21662]: audit 2024-09-15T03:21:32.202537+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:32 smithi104 bash[15781]: audit 2024-09-15T03:21:32.186203+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:32.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:32 smithi104 bash[15781]: audit 2024-09-15T03:21:32.192234+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:32 smithi104 bash[15781]: audit 2024-09-15T03:21:32.192551+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:32.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:32 smithi104 bash[15781]: audit 2024-09-15T03:21:32.194500+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:32.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:32 smithi104 bash[15781]: audit 2024-09-15T03:21:32.198345+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:32.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:32 smithi104 bash[15781]: audit 2024-09-15T03:21:32.202537+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:33.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:33 smithi053 bash[15077]: cluster 2024-09-15T03:21:32.502240+0000 mgr.y (mgr.14150) 189 : cluster [DBG] pgmap v141: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:33.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:33 smithi053 bash[21662]: cluster 2024-09-15T03:21:32.502240+0000 mgr.y (mgr.14150) 189 : cluster [DBG] pgmap v141: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:33.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:33 smithi104 bash[15781]: cluster 2024-09-15T03:21:32.502240+0000 mgr.y (mgr.14150) 189 : cluster [DBG] pgmap v141: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:35.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:35 smithi053 bash[15077]: cluster 2024-09-15T03:21:34.502675+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:35.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:35 smithi053 bash[21662]: cluster 2024-09-15T03:21:34.502675+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:35.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:35 smithi104 bash[15781]: cluster 2024-09-15T03:21:34.502675+0000 mgr.y (mgr.14150) 190 : cluster [DBG] pgmap v142: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:37.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:37 smithi053 bash[15077]: cluster 2024-09-15T03:21:36.503156+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v143: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:37.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:37 smithi053 bash[21662]: cluster 2024-09-15T03:21:36.503156+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v143: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:37.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:37 smithi104 bash[15781]: cluster 2024-09-15T03:21:36.503156+0000 mgr.y (mgr.14150) 191 : cluster [DBG] pgmap v143: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:39.856 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:39 smithi053 bash[15077]: cluster 2024-09-15T03:21:38.503543+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v144: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:39.857 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:39 smithi053 bash[21662]: cluster 2024-09-15T03:21:38.503543+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v144: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:39.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:39 smithi104 bash[15781]: cluster 2024-09-15T03:21:38.503543+0000 mgr.y (mgr.14150) 192 : cluster [DBG] pgmap v144: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:40.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:40 smithi053 bash[15077]: audit 2024-09-15T03:21:40.319584+0000 mon.a (mon.0) 468 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T03:21:40.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:40 smithi053 bash[21662]: audit 2024-09-15T03:21:40.319584+0000 mon.a (mon.0) 468 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T03:21:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:40 smithi104 bash[15781]: audit 2024-09-15T03:21:40.319584+0000 mon.a (mon.0) 468 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T03:21:41.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[21662]: cluster 2024-09-15T03:21:40.503952+0000 mgr.y (mgr.14150) 193 : cluster [DBG] pgmap v145: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:41.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[21662]: audit 2024-09-15T03:21:40.593710+0000 mon.a (mon.0) 469 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T03:21:41.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[21662]: cluster 2024-09-15T03:21:40.593760+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-15T03:21:41.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[21662]: audit 2024-09-15T03:21:40.593874+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:41.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[21662]: audit 2024-09-15T03:21:40.594458+0000 mon.a (mon.0) 472 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:21:41.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[15077]: cluster 2024-09-15T03:21:40.503952+0000 mgr.y (mgr.14150) 193 : cluster [DBG] pgmap v145: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:41.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[15077]: audit 2024-09-15T03:21:40.593710+0000 mon.a (mon.0) 469 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T03:21:41.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[15077]: cluster 2024-09-15T03:21:40.593760+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-15T03:21:41.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[15077]: audit 2024-09-15T03:21:40.593874+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:41.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:41 smithi053 bash[15077]: audit 2024-09-15T03:21:40.594458+0000 mon.a (mon.0) 472 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:21:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:41 smithi104 bash[15781]: cluster 2024-09-15T03:21:40.503952+0000 mgr.y (mgr.14150) 193 : cluster [DBG] pgmap v145: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:41 smithi104 bash[15781]: audit 2024-09-15T03:21:40.593710+0000 mon.a (mon.0) 469 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T03:21:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:41 smithi104 bash[15781]: cluster 2024-09-15T03:21:40.593760+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-09-15T03:21:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:41 smithi104 bash[15781]: audit 2024-09-15T03:21:40.593874+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:41.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:41 smithi104 bash[15781]: audit 2024-09-15T03:21:40.594458+0000 mon.a (mon.0) 472 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:21:42.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.597035+0000 mon.a (mon.0) 473 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:21:42.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: cluster 2024-09-15T03:21:41.597106+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.597619+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.603645+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.927880+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.932716+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.935664+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.939375+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.939657+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.940896+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[15077]: audit 2024-09-15T03:21:41.947796+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.597035+0000 mon.a (mon.0) 473 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: cluster 2024-09-15T03:21:41.597106+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.597619+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.603645+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.927880+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.932716+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.935664+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.939375+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.939657+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.940896+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:42.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:42 smithi053 bash[21662]: audit 2024-09-15T03:21:41.947796+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.597035+0000 mon.a (mon.0) 473 : audit [INF] from='osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:21:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: cluster 2024-09-15T03:21:41.597106+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-09-15T03:21:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.597619+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.603645+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.927880+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.932716+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.935664+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.939375+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.939657+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.940896+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:42 smithi104 bash[15781]: audit 2024-09-15T03:21:41.947796+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:43.528 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 2 on host 'smithi053' 2024-09-15T03:21:44.252 DEBUG:teuthology.orchestra.run.smithi053:osd.2> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T03:21:44.255 INFO:tasks.cephadm:Deploying osd.3 on smithi053 with /dev/nvme1n1... 2024-09-15T03:21:44.255 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme1n1 2024-09-15T03:21:44.313 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: cluster 2024-09-15T03:21:41.360813+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:21:44.313 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: cluster 2024-09-15T03:21:41.360864+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:21:44.313 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: cluster 2024-09-15T03:21:42.504388+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v148: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:44.313 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: cluster 2024-09-15T03:21:42.604082+0000 mon.a (mon.0) 484 : cluster [INF] osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472] boot 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: cluster 2024-09-15T03:21:42.604157+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:42.604721+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.210597+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.215210+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.221959+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.512367+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.519540+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.519965+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.521780+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.525961+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.314 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[21662]: audit 2024-09-15T03:21:43.530375+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: cluster 2024-09-15T03:21:41.360813+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: cluster 2024-09-15T03:21:41.360864+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: cluster 2024-09-15T03:21:42.504388+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v148: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: cluster 2024-09-15T03:21:42.604082+0000 mon.a (mon.0) 484 : cluster [INF] osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472] boot 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: cluster 2024-09-15T03:21:42.604157+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:42.604721+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.210597+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.215210+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.221959+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.512367+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:44.315 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.519540+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.316 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.519965+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:44.316 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.521780+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:44.316 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.525961+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.316 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:44 smithi053 bash[15077]: audit 2024-09-15T03:21:43.530375+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.387 INFO:journalctl@ceph.osd.2.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: cluster 2024-09-15T03:21:41.360813+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: cluster 2024-09-15T03:21:41.360864+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: cluster 2024-09-15T03:21:42.504388+0000 mgr.y (mgr.14150) 194 : cluster [DBG] pgmap v148: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: cluster 2024-09-15T03:21:42.604082+0000 mon.a (mon.0) 484 : cluster [INF] osd.2 [v2:172.21.15.53:6818/3584076472,v1:172.21.15.53:6819/3584076472] boot 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: cluster 2024-09-15T03:21:42.604157+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:42.604721+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.210597+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.215210+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.464 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.221959+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.465 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.512367+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:44.465 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.519540+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.465 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.519965+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:44.465 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.521780+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:44.465 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.525961+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:44.465 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:44 smithi104 bash[15781]: audit 2024-09-15T03:21:43.530375+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: cluster 2024-09-15T03:21:43.524636+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v150: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:43.569927+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-15T03:21:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.225842+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-15T03:21:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: cluster 2024-09-15T03:21:44.225943+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-15T03:21:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.227268+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.513212+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.519671+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.522861+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: cluster 2024-09-15T03:21:44.523212+0000 mon.a (mon.0) 503 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.527259+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.527703+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.531219+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: cluster 2024-09-15T03:21:44.533266+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v152: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[21662]: audit 2024-09-15T03:21:44.537009+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: cluster 2024-09-15T03:21:43.524636+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v150: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:43.569927+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.225842+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: cluster 2024-09-15T03:21:44.225943+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.227268+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.513212+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.519671+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.522861+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:45.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: cluster 2024-09-15T03:21:44.523212+0000 mon.a (mon.0) 503 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:21:45.444 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.527259+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.444 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.527703+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:45.444 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.531219+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:45.444 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: cluster 2024-09-15T03:21:44.533266+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v152: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:45.444 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:45 smithi053 bash[15077]: audit 2024-09-15T03:21:44.537009+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: cluster 2024-09-15T03:21:43.524636+0000 mgr.y (mgr.14150) 195 : cluster [DBG] pgmap v150: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-15T03:21:45.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:43.569927+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-15T03:21:45.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.225842+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-15T03:21:45.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: cluster 2024-09-15T03:21:44.225943+0000 mon.a (mon.0) 498 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.227268+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.513212+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.519671+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.522861+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: cluster 2024-09-15T03:21:44.523212+0000 mon.a (mon.0) 503 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.527259+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.527703+0000 mon.a (mon.0) 505 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.531219+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: cluster 2024-09-15T03:21:44.533266+0000 mgr.y (mgr.14150) 196 : cluster [DBG] pgmap v152: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:45 smithi104 bash[15781]: audit 2024-09-15T03:21:44.537009+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:46.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:46 smithi104 bash[15781]: audit 2024-09-15T03:21:45.230094+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T03:21:46.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:46 smithi104 bash[15781]: cluster 2024-09-15T03:21:45.230243+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-15T03:21:46.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:46 smithi104 bash[15781]: cluster 2024-09-15T03:21:45.528613+0000 mon.a (mon.0) 510 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T03:21:46.482 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:46 smithi104 bash[15781]: cluster 2024-09-15T03:21:45.528691+0000 mon.a (mon.0) 511 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:21:46.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[15077]: audit 2024-09-15T03:21:45.230094+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T03:21:46.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[15077]: cluster 2024-09-15T03:21:45.230243+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-15T03:21:46.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[15077]: cluster 2024-09-15T03:21:45.528613+0000 mon.a (mon.0) 510 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T03:21:46.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[15077]: cluster 2024-09-15T03:21:45.528691+0000 mon.a (mon.0) 511 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:21:46.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[21662]: audit 2024-09-15T03:21:45.230094+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T03:21:46.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[21662]: cluster 2024-09-15T03:21:45.230243+0000 mon.a (mon.0) 509 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-09-15T03:21:46.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[21662]: cluster 2024-09-15T03:21:45.528613+0000 mon.a (mon.0) 510 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T03:21:46.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:46 smithi053 bash[21662]: cluster 2024-09-15T03:21:45.528691+0000 mon.a (mon.0) 511 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:21:47.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:47 smithi053 bash[15077]: cluster 2024-09-15T03:21:46.533583+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v154: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:47.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:47 smithi053 bash[15077]: cluster 2024-09-15T03:21:46.537835+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-15T03:21:47.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:47 smithi053 bash[15077]: audit 2024-09-15T03:21:46.901696+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:47.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:47 smithi053 bash[21662]: cluster 2024-09-15T03:21:46.533583+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v154: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:47.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:47 smithi053 bash[21662]: cluster 2024-09-15T03:21:46.537835+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-15T03:21:47.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:47 smithi053 bash[21662]: audit 2024-09-15T03:21:46.901696+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:47 smithi104 bash[15781]: cluster 2024-09-15T03:21:46.533583+0000 mgr.y (mgr.14150) 197 : cluster [DBG] pgmap v154: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:47 smithi104 bash[15781]: cluster 2024-09-15T03:21:46.537835+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-09-15T03:21:47.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:47 smithi104 bash[15781]: audit 2024-09-15T03:21:46.901696+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:48.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:48 smithi053 bash[15077]: cluster 2024-09-15T03:21:47.534285+0000 mon.a (mon.0) 514 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T03:21:48.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:48 smithi053 bash[15077]: cluster 2024-09-15T03:21:47.534364+0000 mon.a (mon.0) 515 : cluster [INF] Cluster is now healthy 2024-09-15T03:21:48.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:48 smithi053 bash[15077]: audit 2024-09-15T03:21:47.836338+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:48.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:48 smithi053 bash[21662]: cluster 2024-09-15T03:21:47.534285+0000 mon.a (mon.0) 514 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T03:21:48.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:48 smithi053 bash[21662]: cluster 2024-09-15T03:21:47.534364+0000 mon.a (mon.0) 515 : cluster [INF] Cluster is now healthy 2024-09-15T03:21:48.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:48 smithi053 bash[21662]: audit 2024-09-15T03:21:47.836338+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:48 smithi104 bash[15781]: cluster 2024-09-15T03:21:47.534285+0000 mon.a (mon.0) 514 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T03:21:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:48 smithi104 bash[15781]: cluster 2024-09-15T03:21:47.534364+0000 mon.a (mon.0) 515 : cluster [INF] Cluster is now healthy 2024-09-15T03:21:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:48 smithi104 bash[15781]: audit 2024-09-15T03:21:47.836338+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:49.067 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:21:49.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:49 smithi104 bash[15781]: cluster 2024-09-15T03:21:48.553458+0000 mon.a (mon.0) 517 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-15T03:21:49.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:49 smithi104 bash[15781]: audit 2024-09-15T03:21:48.777517+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:49.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:49 smithi104 bash[15781]: audit 2024-09-15T03:21:48.779080+0000 mon.a (mon.0) 519 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:50.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:49 smithi053 bash[15077]: cluster 2024-09-15T03:21:48.553458+0000 mon.a (mon.0) 517 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-15T03:21:50.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:49 smithi053 bash[15077]: audit 2024-09-15T03:21:48.777517+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:50.161 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:49 smithi053 bash[15077]: audit 2024-09-15T03:21:48.779080+0000 mon.a (mon.0) 519 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:50.161 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:49 smithi053 bash[21662]: cluster 2024-09-15T03:21:48.553458+0000 mon.a (mon.0) 517 : cluster [DBG] mgrmap e15: y(active, since 4m), standbys: x 2024-09-15T03:21:50.161 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:49 smithi053 bash[21662]: audit 2024-09-15T03:21:48.777517+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:50.161 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:49 smithi053 bash[21662]: audit 2024-09-15T03:21:48.779080+0000 mon.a (mon.0) 519 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:51.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: cluster 2024-09-15T03:21:48.534024+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.692890+0000 mon.a (mon.0) 520 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.694048+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.694401+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.694590+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.716455+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.718305+0000 mon.b (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.718682+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.718970+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:49.719243+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:50.613042+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:50.645503+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:50.647236+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:50.647468+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[21662]: audit 2024-09-15T03:21:50.647717+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: cluster 2024-09-15T03:21:48.534024+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.692890+0000 mon.a (mon.0) 520 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.694048+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.694401+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.694590+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.716455+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.718305+0000 mon.b (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.718682+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.718970+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:49.719243+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:50.613042+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:51.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:50.645503+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:51.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:50.647236+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:50.647468+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:51 smithi053 bash[15077]: audit 2024-09-15T03:21:50.647717+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: cluster 2024-09-15T03:21:48.534024+0000 mgr.y (mgr.14150) 198 : cluster [DBG] pgmap v156: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.692890+0000 mon.a (mon.0) 520 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.694048+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.694401+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.694590+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.716455+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.718305+0000 mon.b (mon.1) 7 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.718682+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.718970+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:49.719243+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:50.613042+0000 mon.b (mon.1) 8 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:50.645503+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:50.647236+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:50.647468+0000 mon.a (mon.0) 530 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:21:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:51 smithi104 bash[15781]: audit 2024-09-15T03:21:50.647717+0000 mon.a (mon.0) 531 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:21:52.554 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/nvme1n1 2024-09-15T03:21:52.555 INFO:teuthology.orchestra.run.smithi053.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:21:52.560 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=10 conv=fsync 2024-09-15T03:21:52.579 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2024-09-15T03:21:52.579 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2024-09-15T03:21:52.579 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0155425 s, 675 MB/s 2024-09-15T03:21:52.579 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2024-09-15T03:21:52.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:52 smithi053 bash[15077]: cluster 2024-09-15T03:21:50.534640+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:52.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:52 smithi053 bash[15077]: audit 2024-09-15T03:21:50.647001+0000 mon.c (mon.2) 5 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:52.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:52 smithi053 bash[15077]: audit 2024-09-15T03:21:51.571592+0000 mon.c (mon.2) 6 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:52.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:52 smithi053 bash[21662]: cluster 2024-09-15T03:21:50.534640+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:52.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:52 smithi053 bash[21662]: audit 2024-09-15T03:21:50.647001+0000 mon.c (mon.2) 5 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:52.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:52 smithi053 bash[21662]: audit 2024-09-15T03:21:51.571592+0000 mon.c (mon.2) 6 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:52.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:52 smithi104 bash[15781]: cluster 2024-09-15T03:21:50.534640+0000 mgr.y (mgr.14150) 199 : cluster [DBG] pgmap v157: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:52.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:52 smithi104 bash[15781]: audit 2024-09-15T03:21:50.647001+0000 mon.c (mon.2) 5 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T03:21:52.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:52 smithi104 bash[15781]: audit 2024-09-15T03:21:51.571592+0000 mon.c (mon.2) 6 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T03:21:53.284 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi053:/dev/nvme1n1 2024-09-15T03:21:53.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:53 smithi053 bash[15077]: cluster 2024-09-15T03:21:52.535210+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:53.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:53 smithi053 bash[21662]: cluster 2024-09-15T03:21:52.535210+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:53.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:53 smithi104 bash[15781]: cluster 2024-09-15T03:21:52.535210+0000 mgr.y (mgr.14150) 200 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:55.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:55 smithi053 bash[15077]: cluster 2024-09-15T03:21:54.535756+0000 mgr.y (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:55.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:55 smithi053 bash[21662]: cluster 2024-09-15T03:21:54.535756+0000 mgr.y (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:55.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:55 smithi104 bash[15781]: cluster 2024-09-15T03:21:54.535756+0000 mgr.y (mgr.14150) 201 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:21:57.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:57 smithi053 bash[15077]: cluster 2024-09-15T03:21:56.536214+0000 mgr.y (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-15T03:21:57.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:57 smithi053 bash[21662]: cluster 2024-09-15T03:21:56.536214+0000 mgr.y (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-15T03:21:57.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:57 smithi104 bash[15781]: cluster 2024-09-15T03:21:56.536214+0000 mgr.y (mgr.14150) 202 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-09-15T03:21:58.093 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:21:59.925 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:21:59 smithi053 bash[21662]: cluster 2024-09-15T03:21:58.536775+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-15T03:21:59.926 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:21:59 smithi053 bash[15077]: cluster 2024-09-15T03:21:58.536775+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-15T03:21:59.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:21:59 smithi104 bash[15781]: cluster 2024-09-15T03:21:58.536775+0000 mgr.y (mgr.14150) 203 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-15T03:22:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[21662]: cluster 2024-09-15T03:22:00.537335+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-15T03:22:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[21662]: audit 2024-09-15T03:22:01.482305+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[21662]: audit 2024-09-15T03:22:01.488764+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[21662]: audit 2024-09-15T03:22:01.496157+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[15077]: cluster 2024-09-15T03:22:00.537335+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-15T03:22:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[15077]: audit 2024-09-15T03:22:01.482305+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[15077]: audit 2024-09-15T03:22:01.488764+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:01 smithi053 bash[15077]: audit 2024-09-15T03:22:01.496157+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:01 smithi104 bash[15781]: cluster 2024-09-15T03:22:00.537335+0000 mgr.y (mgr.14150) 204 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-15T03:22:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:01 smithi104 bash[15781]: audit 2024-09-15T03:22:01.482305+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:01 smithi104 bash[15781]: audit 2024-09-15T03:22:01.488764+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:01 smithi104 bash[15781]: audit 2024-09-15T03:22:01.496157+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:02.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:02 smithi053 bash[21662]: audit 2024-09-15T03:22:01.854352+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:22:02.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:02 smithi053 bash[21662]: audit 2024-09-15T03:22:01.859104+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:22:02.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:02 smithi053 bash[21662]: audit 2024-09-15T03:22:01.860325+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:02.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:02 smithi053 bash[15077]: audit 2024-09-15T03:22:01.854352+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:22:02.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:02 smithi053 bash[15077]: audit 2024-09-15T03:22:01.859104+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:22:02.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:02 smithi053 bash[15077]: audit 2024-09-15T03:22:01.860325+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:02.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:02 smithi104 bash[15781]: audit 2024-09-15T03:22:01.854352+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:22:02.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:02 smithi104 bash[15781]: audit 2024-09-15T03:22:01.859104+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:22:02.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:02 smithi104 bash[15781]: audit 2024-09-15T03:22:01.860325+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:03.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[21662]: audit 2024-09-15T03:22:01.848876+0000 mgr.y (mgr.14150) 205 : audit [DBG] from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:22:03.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[21662]: cluster 2024-09-15T03:22:02.537908+0000 mgr.y (mgr.14150) 206 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-15T03:22:03.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[21662]: audit 2024-09-15T03:22:03.379751+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[21662]: audit 2024-09-15T03:22:03.385359+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[21662]: audit 2024-09-15T03:22:03.392931+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[15077]: audit 2024-09-15T03:22:01.848876+0000 mgr.y (mgr.14150) 205 : audit [DBG] from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:22:03.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[15077]: cluster 2024-09-15T03:22:02.537908+0000 mgr.y (mgr.14150) 206 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-15T03:22:03.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[15077]: audit 2024-09-15T03:22:03.379751+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[15077]: audit 2024-09-15T03:22:03.385359+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:03 smithi053 bash[15077]: audit 2024-09-15T03:22:03.392931+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:03 smithi104 bash[15781]: audit 2024-09-15T03:22:01.848876+0000 mgr.y (mgr.14150) 205 : audit [DBG] from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:22:03.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:03 smithi104 bash[15781]: cluster 2024-09-15T03:22:02.537908+0000 mgr.y (mgr.14150) 206 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-15T03:22:03.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:03 smithi104 bash[15781]: audit 2024-09-15T03:22:03.379751+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:03 smithi104 bash[15781]: audit 2024-09-15T03:22:03.385359+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:03.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:03 smithi104 bash[15781]: audit 2024-09-15T03:22:03.392931+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:05.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:05 smithi053 bash[21662]: cluster 2024-09-15T03:22:04.538437+0000 mgr.y (mgr.14150) 207 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-15T03:22:05.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:05 smithi053 bash[15077]: cluster 2024-09-15T03:22:04.538437+0000 mgr.y (mgr.14150) 207 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-15T03:22:05.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:05 smithi104 bash[15781]: cluster 2024-09-15T03:22:04.538437+0000 mgr.y (mgr.14150) 207 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-15T03:22:07.900 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:07 smithi053 bash[15077]: cluster 2024-09-15T03:22:06.538989+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-15T03:22:07.900 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:07 smithi053 bash[21662]: cluster 2024-09-15T03:22:06.538989+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-15T03:22:07.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:07 smithi104 bash[15781]: cluster 2024-09-15T03:22:06.538989+0000 mgr.y (mgr.14150) 208 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-15T03:22:09.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:09 smithi053 bash[21662]: cluster 2024-09-15T03:22:08.539367+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:09.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:09 smithi053 bash[15077]: cluster 2024-09-15T03:22:08.539367+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:09.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:09 smithi104 bash[15781]: cluster 2024-09-15T03:22:08.539367+0000 mgr.y (mgr.14150) 209 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[15077]: audit 2024-09-15T03:22:10.554254+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.53:0/1974090260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89da8702-b0ab-4acc-89dc-8e53d40e80bc"}]: dispatch 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[15077]: audit 2024-09-15T03:22:10.562350+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.53:0/1974090260' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89da8702-b0ab-4acc-89dc-8e53d40e80bc"}]': finished 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[15077]: cluster 2024-09-15T03:22:10.562503+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[15077]: audit 2024-09-15T03:22:10.562735+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[21662]: audit 2024-09-15T03:22:10.554254+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.53:0/1974090260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89da8702-b0ab-4acc-89dc-8e53d40e80bc"}]: dispatch 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[21662]: audit 2024-09-15T03:22:10.562350+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.53:0/1974090260' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89da8702-b0ab-4acc-89dc-8e53d40e80bc"}]': finished 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[21662]: cluster 2024-09-15T03:22:10.562503+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-09-15T03:22:10.891 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:10 smithi053 bash[21662]: audit 2024-09-15T03:22:10.562735+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:10.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:10 smithi104 bash[15781]: audit 2024-09-15T03:22:10.554254+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.53:0/1974090260' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89da8702-b0ab-4acc-89dc-8e53d40e80bc"}]: dispatch 2024-09-15T03:22:10.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:10 smithi104 bash[15781]: audit 2024-09-15T03:22:10.562350+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.53:0/1974090260' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89da8702-b0ab-4acc-89dc-8e53d40e80bc"}]': finished 2024-09-15T03:22:10.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:10 smithi104 bash[15781]: cluster 2024-09-15T03:22:10.562503+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2024-09-15T03:22:10.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:10 smithi104 bash[15781]: audit 2024-09-15T03:22:10.562735+0000 mon.a (mon.0) 544 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:11.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:11 smithi053 bash[21662]: cluster 2024-09-15T03:22:10.539853+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:11.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:11 smithi053 bash[15077]: cluster 2024-09-15T03:22:10.539853+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:11.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:11 smithi104 bash[15781]: cluster 2024-09-15T03:22:10.539853+0000 mgr.y (mgr.14150) 210 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:12.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:12 smithi053 bash[21662]: audit 2024-09-15T03:22:12.134642+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.53:0/3700231422' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:22:12.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:12 smithi053 bash[15077]: audit 2024-09-15T03:22:12.134642+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.53:0/3700231422' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:22:12.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:12 smithi104 bash[15781]: audit 2024-09-15T03:22:12.134642+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.53:0/3700231422' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:22:13.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:13 smithi053 bash[21662]: cluster 2024-09-15T03:22:12.540445+0000 mgr.y (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:13.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:13 smithi053 bash[15077]: cluster 2024-09-15T03:22:12.540445+0000 mgr.y (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:13.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:13 smithi104 bash[15781]: cluster 2024-09-15T03:22:12.540445+0000 mgr.y (mgr.14150) 211 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 875 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:15.925 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:15 smithi053 bash[15077]: cluster 2024-09-15T03:22:14.540957+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:15.926 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:15 smithi053 bash[21662]: cluster 2024-09-15T03:22:14.540957+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:15.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:15 smithi104 bash[15781]: cluster 2024-09-15T03:22:14.540957+0000 mgr.y (mgr.14150) 212 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:17.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:17 smithi053 bash[15077]: cluster 2024-09-15T03:22:16.541509+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:17.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:17 smithi053 bash[21662]: cluster 2024-09-15T03:22:16.541509+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:17.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:17 smithi104 bash[15781]: cluster 2024-09-15T03:22:16.541509+0000 mgr.y (mgr.14150) 213 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:19.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:19 smithi053 bash[15077]: cluster 2024-09-15T03:22:18.541978+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:19.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:19 smithi053 bash[21662]: cluster 2024-09-15T03:22:18.541978+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:19.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:19 smithi104 bash[15781]: cluster 2024-09-15T03:22:18.541978+0000 mgr.y (mgr.14150) 214 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:21.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:21 smithi053 bash[15077]: cluster 2024-09-15T03:22:20.542610+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:21.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:21 smithi053 bash[21662]: cluster 2024-09-15T03:22:20.542610+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:21.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:21 smithi104 bash[15781]: cluster 2024-09-15T03:22:20.542610+0000 mgr.y (mgr.14150) 215 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[15077]: audit 2024-09-15T03:22:21.703774+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[15077]: audit 2024-09-15T03:22:21.711009+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[15077]: cephadm 2024-09-15T03:22:21.712834+0000 mgr.y (mgr.14150) 216 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:22:22.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[15077]: audit 2024-09-15T03:22:21.717525+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[21662]: audit 2024-09-15T03:22:21.703774+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[21662]: audit 2024-09-15T03:22:21.711009+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[21662]: cephadm 2024-09-15T03:22:21.712834+0000 mgr.y (mgr.14150) 216 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:22:22.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:22 smithi053 bash[21662]: audit 2024-09-15T03:22:21.717525+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.979 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:22 smithi104 bash[15781]: audit 2024-09-15T03:22:21.703774+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.980 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:22 smithi104 bash[15781]: audit 2024-09-15T03:22:21.711009+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:22.980 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:22 smithi104 bash[15781]: cephadm 2024-09-15T03:22:21.712834+0000 mgr.y (mgr.14150) 216 : cephadm [INF] Detected new or changed devices on smithi053 2024-09-15T03:22:22.980 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:22 smithi104 bash[15781]: audit 2024-09-15T03:22:21.717525+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:23.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:23 smithi104 bash[15781]: cluster 2024-09-15T03:22:22.543287+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:23.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:23 smithi104 bash[15781]: audit 2024-09-15T03:22:23.546108+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:23.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:23 smithi104 bash[15781]: audit 2024-09-15T03:22:23.552247+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:23.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:23 smithi104 bash[15781]: audit 2024-09-15T03:22:23.558117+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:24.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[15077]: cluster 2024-09-15T03:22:22.543287+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:24.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[15077]: audit 2024-09-15T03:22:23.546108+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:24.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[15077]: audit 2024-09-15T03:22:23.552247+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:24.048 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[15077]: audit 2024-09-15T03:22:23.558117+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:24.049 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[21662]: cluster 2024-09-15T03:22:22.543287+0000 mgr.y (mgr.14150) 217 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:24.049 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[21662]: audit 2024-09-15T03:22:23.546108+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:24.049 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[21662]: audit 2024-09-15T03:22:23.552247+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:24.049 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:23 smithi053 bash[21662]: audit 2024-09-15T03:22:23.558117+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:25.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:25 smithi053 bash[15077]: cluster 2024-09-15T03:22:24.543822+0000 mgr.y (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:25.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:25 smithi053 bash[15077]: audit 2024-09-15T03:22:25.130867+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T03:22:25.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:25 smithi053 bash[15077]: audit 2024-09-15T03:22:25.132427+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:25.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:25 smithi053 bash[21662]: cluster 2024-09-15T03:22:24.543822+0000 mgr.y (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:25.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:25 smithi053 bash[21662]: audit 2024-09-15T03:22:25.130867+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T03:22:25.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:25 smithi053 bash[21662]: audit 2024-09-15T03:22:25.132427+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:25.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:25 smithi104 bash[15781]: cluster 2024-09-15T03:22:24.543822+0000 mgr.y (mgr.14150) 218 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:25.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:25 smithi104 bash[15781]: audit 2024-09-15T03:22:25.130867+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T03:22:25.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:25 smithi104 bash[15781]: audit 2024-09-15T03:22:25.132427+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:26.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:26 smithi104 bash[15781]: cephadm 2024-09-15T03:22:25.133463+0000 mgr.y (mgr.14150) 219 : cephadm [INF] Deploying daemon osd.3 on smithi053 2024-09-15T03:22:27.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:26 smithi053 bash[15077]: cephadm 2024-09-15T03:22:25.133463+0000 mgr.y (mgr.14150) 219 : cephadm [INF] Deploying daemon osd.3 on smithi053 2024-09-15T03:22:27.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:26 smithi053 bash[21662]: cephadm 2024-09-15T03:22:25.133463+0000 mgr.y (mgr.14150) 219 : cephadm [INF] Deploying daemon osd.3 on smithi053 2024-09-15T03:22:28.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:27 smithi053 bash[21662]: cluster 2024-09-15T03:22:26.544294+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:28.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:27 smithi053 bash[15077]: cluster 2024-09-15T03:22:26.544294+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:28.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:27 smithi104 bash[15781]: cluster 2024-09-15T03:22:26.544294+0000 mgr.y (mgr.14150) 220 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:29.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:29 smithi053 bash[15077]: cluster 2024-09-15T03:22:28.544781+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:29.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:29 smithi053 bash[21662]: cluster 2024-09-15T03:22:28.544781+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:30.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:29 smithi104 bash[15781]: cluster 2024-09-15T03:22:28.544781+0000 mgr.y (mgr.14150) 221 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:30.990 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[15077]: audit 2024-09-15T03:22:29.877434+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:30.990 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[15077]: audit 2024-09-15T03:22:29.882676+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:30.990 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[15077]: audit 2024-09-15T03:22:29.882986+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:30.991 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[15077]: audit 2024-09-15T03:22:29.885859+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:30.991 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[15077]: audit 2024-09-15T03:22:29.888722+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:30.991 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[15077]: audit 2024-09-15T03:22:29.895513+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:30.991 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[21662]: audit 2024-09-15T03:22:29.877434+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:30.992 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[21662]: audit 2024-09-15T03:22:29.882676+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:30.992 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[21662]: audit 2024-09-15T03:22:29.882986+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:30.992 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[21662]: audit 2024-09-15T03:22:29.885859+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:30.992 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[21662]: audit 2024-09-15T03:22:29.888722+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:30.992 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:30 smithi053 bash[21662]: audit 2024-09-15T03:22:29.895513+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:31.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:30 smithi104 bash[15781]: audit 2024-09-15T03:22:29.877434+0000 mon.a (mon.0) 553 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:30 smithi104 bash[15781]: audit 2024-09-15T03:22:29.882676+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:30 smithi104 bash[15781]: audit 2024-09-15T03:22:29.882986+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:30 smithi104 bash[15781]: audit 2024-09-15T03:22:29.885859+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:30 smithi104 bash[15781]: audit 2024-09-15T03:22:29.888722+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:30 smithi104 bash[15781]: audit 2024-09-15T03:22:29.895513+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:31.888 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:31 smithi053 bash[15077]: cluster 2024-09-15T03:22:30.545305+0000 mgr.y (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:31.888 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:31 smithi053 bash[21662]: cluster 2024-09-15T03:22:30.545305+0000 mgr.y (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:32.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:31 smithi104 bash[15781]: cluster 2024-09-15T03:22:30.545305+0000 mgr.y (mgr.14150) 222 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:34.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:33 smithi053 bash[15077]: cluster 2024-09-15T03:22:32.545699+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:34.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:33 smithi053 bash[21662]: cluster 2024-09-15T03:22:32.545699+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:34.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:33 smithi104 bash[15781]: cluster 2024-09-15T03:22:32.545699+0000 mgr.y (mgr.14150) 223 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:36.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:35 smithi053 bash[15077]: cluster 2024-09-15T03:22:34.546275+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:35 smithi053 bash[21662]: cluster 2024-09-15T03:22:34.546275+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:36.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:35 smithi104 bash[15781]: cluster 2024-09-15T03:22:34.546275+0000 mgr.y (mgr.14150) 224 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:38.013 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:37 smithi053 bash[21662]: cluster 2024-09-15T03:22:36.546760+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:38.013 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:37 smithi053 bash[21662]: audit 2024-09-15T03:22:36.980717+0000 mon.a (mon.0) 559 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T03:22:38.013 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:37 smithi053 bash[15077]: cluster 2024-09-15T03:22:36.546760+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:38.013 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:37 smithi053 bash[15077]: audit 2024-09-15T03:22:36.980717+0000 mon.a (mon.0) 559 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T03:22:38.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:37 smithi104 bash[15781]: cluster 2024-09-15T03:22:36.546760+0000 mgr.y (mgr.14150) 225 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:38.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:37 smithi104 bash[15781]: audit 2024-09-15T03:22:36.980717+0000 mon.a (mon.0) 559 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T03:22:39.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[15077]: audit 2024-09-15T03:22:37.753714+0000 mon.a (mon.0) 560 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T03:22:39.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[15077]: cluster 2024-09-15T03:22:37.753777+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-15T03:22:39.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[15077]: audit 2024-09-15T03:22:37.754197+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:39.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[15077]: audit 2024-09-15T03:22:37.754668+0000 mon.a (mon.0) 563 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:22:39.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[21662]: audit 2024-09-15T03:22:37.753714+0000 mon.a (mon.0) 560 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T03:22:39.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[21662]: cluster 2024-09-15T03:22:37.753777+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-15T03:22:39.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[21662]: audit 2024-09-15T03:22:37.754197+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:39.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:38 smithi053 bash[21662]: audit 2024-09-15T03:22:37.754668+0000 mon.a (mon.0) 563 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:22:39.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:38 smithi104 bash[15781]: audit 2024-09-15T03:22:37.753714+0000 mon.a (mon.0) 560 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T03:22:39.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:38 smithi104 bash[15781]: cluster 2024-09-15T03:22:37.753777+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-09-15T03:22:39.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:38 smithi104 bash[15781]: audit 2024-09-15T03:22:37.754197+0000 mon.a (mon.0) 562 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:39.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:38 smithi104 bash[15781]: audit 2024-09-15T03:22:37.754668+0000 mon.a (mon.0) 563 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2024-09-15T03:22:40.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[21662]: cluster 2024-09-15T03:22:38.547212+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:40.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[21662]: audit 2024-09-15T03:22:38.758092+0000 mon.a (mon.0) 564 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:22:40.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[21662]: cluster 2024-09-15T03:22:38.758346+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-15T03:22:40.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[21662]: audit 2024-09-15T03:22:38.758572+0000 mon.a (mon.0) 566 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[21662]: audit 2024-09-15T03:22:38.765476+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[15077]: cluster 2024-09-15T03:22:38.547212+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[15077]: audit 2024-09-15T03:22:38.758092+0000 mon.a (mon.0) 564 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:22:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[15077]: cluster 2024-09-15T03:22:38.758346+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-15T03:22:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[15077]: audit 2024-09-15T03:22:38.758572+0000 mon.a (mon.0) 566 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:39 smithi053 bash[15077]: audit 2024-09-15T03:22:38.765476+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:39 smithi104 bash[15781]: cluster 2024-09-15T03:22:38.547212+0000 mgr.y (mgr.14150) 226 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:40.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:39 smithi104 bash[15781]: audit 2024-09-15T03:22:38.758092+0000 mon.a (mon.0) 564 : audit [INF] from='osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2024-09-15T03:22:40.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:39 smithi104 bash[15781]: cluster 2024-09-15T03:22:38.758346+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-09-15T03:22:40.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:39 smithi104 bash[15781]: audit 2024-09-15T03:22:38.758572+0000 mon.a (mon.0) 566 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:39 smithi104 bash[15781]: audit 2024-09-15T03:22:38.765476+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[15077]: cluster 2024-09-15T03:22:38.023270+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:22:40.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[15077]: cluster 2024-09-15T03:22:38.023357+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:22:40.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[15077]: audit 2024-09-15T03:22:39.766794+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[15077]: cluster 2024-09-15T03:22:39.772916+0000 mon.a (mon.0) 569 : cluster [INF] osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263] boot 2024-09-15T03:22:40.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[15077]: cluster 2024-09-15T03:22:39.772961+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-09-15T03:22:40.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[15077]: audit 2024-09-15T03:22:39.773352+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[21662]: cluster 2024-09-15T03:22:38.023270+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:22:40.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[21662]: cluster 2024-09-15T03:22:38.023357+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:22:40.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[21662]: audit 2024-09-15T03:22:39.766794+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:40.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[21662]: cluster 2024-09-15T03:22:39.772916+0000 mon.a (mon.0) 569 : cluster [INF] osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263] boot 2024-09-15T03:22:40.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[21662]: cluster 2024-09-15T03:22:39.772961+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-09-15T03:22:40.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:40 smithi053 bash[21662]: audit 2024-09-15T03:22:39.773352+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:41.148 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 3 on host 'smithi053' 2024-09-15T03:22:41.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:40 smithi104 bash[15781]: cluster 2024-09-15T03:22:38.023270+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:22:41.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:40 smithi104 bash[15781]: cluster 2024-09-15T03:22:38.023357+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:22:41.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:40 smithi104 bash[15781]: audit 2024-09-15T03:22:39.766794+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:41.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:40 smithi104 bash[15781]: cluster 2024-09-15T03:22:39.772916+0000 mon.a (mon.0) 569 : cluster [INF] osd.3 [v2:172.21.15.53:6826/418709263,v1:172.21.15.53:6827/418709263] boot 2024-09-15T03:22:41.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:40 smithi104 bash[15781]: cluster 2024-09-15T03:22:39.772961+0000 mon.a (mon.0) 570 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2024-09-15T03:22:41.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:40 smithi104 bash[15781]: audit 2024-09-15T03:22:39.773352+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:22:42.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: cluster 2024-09-15T03:22:40.547731+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: cluster 2024-09-15T03:22:40.780357+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.130640+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.139409+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.139895+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.142004+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.146101+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.147883+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.149083+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.156829+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.158706+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.159870+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[15077]: audit 2024-09-15T03:22:41.166251+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: cluster 2024-09-15T03:22:40.547731+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: cluster 2024-09-15T03:22:40.780357+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.130640+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.139409+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.139895+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.142004+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.146101+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.147883+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.149083+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.156829+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.158706+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:42.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.159870+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:42.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:41 smithi053 bash[21662]: audit 2024-09-15T03:22:41.166251+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: cluster 2024-09-15T03:22:40.547731+0000 mgr.y (mgr.14150) 227 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: cluster 2024-09-15T03:22:40.780357+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.130640+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.139409+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.139895+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.142004+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.146101+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.147883+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.149083+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.156829+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.158706+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.159870+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:41 smithi104 bash[15781]: audit 2024-09-15T03:22:41.166251+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.611 DEBUG:teuthology.orchestra.run.smithi053:osd.3> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T03:22:42.613 INFO:tasks.cephadm:Deploying osd.4 on smithi104 with /dev/nvme4n1... 2024-09-15T03:22:42.614 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme4n1 2024-09-15T03:22:42.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: cephadm 2024-09-15T03:22:41.149923+0000 mgr.y (mgr.14150) 228 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 3805M 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: audit 2024-09-15T03:22:41.875230+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: audit 2024-09-15T03:22:41.880842+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: audit 2024-09-15T03:22:41.883175+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: audit 2024-09-15T03:22:41.885966+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: audit 2024-09-15T03:22:41.886126+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: audit 2024-09-15T03:22:41.887093+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[21662]: audit 2024-09-15T03:22:41.892751+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: cephadm 2024-09-15T03:22:41.149923+0000 mgr.y (mgr.14150) 228 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 3805M 2024-09-15T03:22:42.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: audit 2024-09-15T03:22:41.875230+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: audit 2024-09-15T03:22:41.880842+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: audit 2024-09-15T03:22:41.883175+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:42.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: audit 2024-09-15T03:22:41.885966+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:42.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: audit 2024-09-15T03:22:41.886126+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:42.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: audit 2024-09-15T03:22:41.887093+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:42.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:42 smithi053 bash[15077]: audit 2024-09-15T03:22:41.892751+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.053 INFO:journalctl@ceph.osd.3.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:22:43.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: cephadm 2024-09-15T03:22:41.149923+0000 mgr.y (mgr.14150) 228 : cephadm [INF] Adjusting osd_memory_target on smithi053 to 3805M 2024-09-15T03:22:43.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: audit 2024-09-15T03:22:41.875230+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: audit 2024-09-15T03:22:41.880842+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: audit 2024-09-15T03:22:41.883175+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:43.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: audit 2024-09-15T03:22:41.885966+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: audit 2024-09-15T03:22:41.886126+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:43.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: audit 2024-09-15T03:22:41.887093+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:43.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:42 smithi104 bash[15781]: audit 2024-09-15T03:22:41.892751+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.969 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: cluster 2024-09-15T03:22:41.888835+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: cluster 2024-09-15T03:22:42.883966+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.738712+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.747275+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.751251+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.754683+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.760103+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.763110+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.766907+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.767160+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.768770+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:43.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:43 smithi104 bash[15781]: audit 2024-09-15T03:22:43.775938+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: cluster 2024-09-15T03:22:41.888835+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: cluster 2024-09-15T03:22:42.883966+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.738712+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.747275+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.751251+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.754683+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.760103+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.763110+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.766907+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.767160+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.768770+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[15077]: audit 2024-09-15T03:22:43.775938+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: cluster 2024-09-15T03:22:41.888835+0000 mgr.y (mgr.14150) 229 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: cluster 2024-09-15T03:22:42.883966+0000 mon.a (mon.0) 591 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.738712+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.747275+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.751251+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.754683+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.760103+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.763110+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.766907+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.767160+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.768770+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:22:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:43 smithi053 bash[21662]: audit 2024-09-15T03:22:43.775938+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:22:44.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:44 smithi104 bash[15781]: cluster 2024-09-15T03:22:43.770897+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:44.971 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:44 smithi104 bash[15781]: cluster 2024-09-15T03:22:44.764075+0000 mon.a (mon.0) 602 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:22:44.971 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:44 smithi104 bash[15781]: cluster 2024-09-15T03:22:44.764115+0000 mon.a (mon.0) 603 : cluster [INF] Cluster is now healthy 2024-09-15T03:22:45.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:44 smithi053 bash[15077]: cluster 2024-09-15T03:22:43.770897+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:45.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:44 smithi053 bash[15077]: cluster 2024-09-15T03:22:44.764075+0000 mon.a (mon.0) 602 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:22:45.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:44 smithi053 bash[15077]: cluster 2024-09-15T03:22:44.764115+0000 mon.a (mon.0) 603 : cluster [INF] Cluster is now healthy 2024-09-15T03:22:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:44 smithi053 bash[21662]: cluster 2024-09-15T03:22:43.770897+0000 mgr.y (mgr.14150) 230 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:44 smithi053 bash[21662]: cluster 2024-09-15T03:22:44.764075+0000 mon.a (mon.0) 602 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:22:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:44 smithi053 bash[21662]: cluster 2024-09-15T03:22:44.764115+0000 mon.a (mon.0) 603 : cluster [INF] Cluster is now healthy 2024-09-15T03:22:46.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:46 smithi104 bash[15781]: cluster 2024-09-15T03:22:45.771402+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:46 smithi053 bash[15077]: cluster 2024-09-15T03:22:45.771402+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:47.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:46 smithi053 bash[21662]: cluster 2024-09-15T03:22:45.771402+0000 mgr.y (mgr.14150) 231 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:47.512 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:22:48.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:48 smithi104 bash[15781]: cluster 2024-09-15T03:22:47.771949+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:49.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:48 smithi053 bash[15077]: cluster 2024-09-15T03:22:47.771949+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:49.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:48 smithi053 bash[21662]: cluster 2024-09-15T03:22:47.771949+0000 mgr.y (mgr.14150) 232 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:50.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:50 smithi104 bash[15781]: cluster 2024-09-15T03:22:49.772560+0000 mgr.y (mgr.14150) 233 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:51.151 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/nvme4n1 2024-09-15T03:22:51.151 INFO:teuthology.orchestra.run.smithi104.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:22:51.160 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme4n1 bs=1M count=10 conv=fsync 2024-09-15T03:22:51.181 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-09-15T03:22:51.181 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-09-15T03:22:51.181 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0182128 s, 576 MB/s 2024-09-15T03:22:51.182 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-09-15T03:22:51.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:50 smithi053 bash[15077]: cluster 2024-09-15T03:22:49.772560+0000 mgr.y (mgr.14150) 233 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:51.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:50 smithi053 bash[21662]: cluster 2024-09-15T03:22:49.772560+0000 mgr.y (mgr.14150) 233 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:51.878 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi104:/dev/nvme4n1 2024-09-15T03:22:53.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:52 smithi053 bash[15077]: cluster 2024-09-15T03:22:51.773209+0000 mgr.y (mgr.14150) 234 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:53.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:52 smithi053 bash[21662]: cluster 2024-09-15T03:22:51.773209+0000 mgr.y (mgr.14150) 234 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:53.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:52 smithi104 bash[15781]: cluster 2024-09-15T03:22:51.773209+0000 mgr.y (mgr.14150) 234 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:55.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:54 smithi053 bash[15077]: cluster 2024-09-15T03:22:53.773864+0000 mgr.y (mgr.14150) 235 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:55.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:54 smithi053 bash[21662]: cluster 2024-09-15T03:22:53.773864+0000 mgr.y (mgr.14150) 235 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:55.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:54 smithi104 bash[15781]: cluster 2024-09-15T03:22:53.773864+0000 mgr.y (mgr.14150) 235 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:56.596 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:22:56.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:56 smithi104 bash[15781]: cluster 2024-09-15T03:22:55.774497+0000 mgr.y (mgr.14150) 236 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:57.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:56 smithi053 bash[15077]: cluster 2024-09-15T03:22:55.774497+0000 mgr.y (mgr.14150) 236 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:57.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:56 smithi053 bash[21662]: cluster 2024-09-15T03:22:55.774497+0000 mgr.y (mgr.14150) 236 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:59.103 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:22:58 smithi053 bash[21662]: cluster 2024-09-15T03:22:57.775060+0000 mgr.y (mgr.14150) 237 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:59.104 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:22:58 smithi053 bash[15077]: cluster 2024-09-15T03:22:57.775060+0000 mgr.y (mgr.14150) 237 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:22:59.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:22:58 smithi104 bash[15781]: cluster 2024-09-15T03:22:57.775060+0000 mgr.y (mgr.14150) 237 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:01.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[21662]: cluster 2024-09-15T03:22:59.775674+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:01.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[21662]: audit 2024-09-15T03:23:00.166491+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:23:01.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[21662]: audit 2024-09-15T03:23:00.170019+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:23:01.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[21662]: audit 2024-09-15T03:23:00.171220+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:01.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[15077]: cluster 2024-09-15T03:22:59.775674+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:01.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[15077]: audit 2024-09-15T03:23:00.166491+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:23:01.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[15077]: audit 2024-09-15T03:23:00.170019+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:23:01.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:00 smithi053 bash[15077]: audit 2024-09-15T03:23:00.171220+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:01.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:00 smithi104 bash[15781]: cluster 2024-09-15T03:22:59.775674+0000 mgr.y (mgr.14150) 238 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:01.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:00 smithi104 bash[15781]: audit 2024-09-15T03:23:00.166491+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:23:01.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:00 smithi104 bash[15781]: audit 2024-09-15T03:23:00.170019+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:23:01.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:00 smithi104 bash[15781]: audit 2024-09-15T03:23:00.171220+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:02.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:01 smithi053 bash[21662]: audit 2024-09-15T03:23:00.159224+0000 mgr.y (mgr.14150) 239 : audit [DBG] from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:23:02.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:01 smithi053 bash[15077]: audit 2024-09-15T03:23:00.159224+0000 mgr.y (mgr.14150) 239 : audit [DBG] from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:23:02.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:01 smithi104 bash[15781]: audit 2024-09-15T03:23:00.159224+0000 mgr.y (mgr.14150) 239 : audit [DBG] from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:23:03.176 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:02 smithi104 bash[15781]: cluster 2024-09-15T03:23:01.776186+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:03.176 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:02 smithi104 bash[15781]: audit 2024-09-15T03:23:02.469109+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.176 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:02 smithi104 bash[15781]: audit 2024-09-15T03:23:02.475883+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.177 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:02 smithi104 bash[15781]: audit 2024-09-15T03:23:02.482621+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[21662]: cluster 2024-09-15T03:23:01.776186+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:03.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[21662]: audit 2024-09-15T03:23:02.469109+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[21662]: audit 2024-09-15T03:23:02.475883+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[21662]: audit 2024-09-15T03:23:02.482621+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[15077]: cluster 2024-09-15T03:23:01.776186+0000 mgr.y (mgr.14150) 240 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[15077]: audit 2024-09-15T03:23:02.469109+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[15077]: audit 2024-09-15T03:23:02.475883+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:02 smithi053 bash[15077]: audit 2024-09-15T03:23:02.482621+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:03 smithi053 bash[15077]: cluster 2024-09-15T03:23:03.776697+0000 mgr.y (mgr.14150) 241 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:04.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:03 smithi053 bash[21662]: cluster 2024-09-15T03:23:03.776697+0000 mgr.y (mgr.14150) 241 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:04.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:03 smithi104 bash[15781]: cluster 2024-09-15T03:23:03.776697+0000 mgr.y (mgr.14150) 241 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:05.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:04 smithi053 bash[15077]: audit 2024-09-15T03:23:03.928261+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:04 smithi053 bash[15077]: audit 2024-09-15T03:23:03.934246+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:04 smithi053 bash[15077]: audit 2024-09-15T03:23:03.940499+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:04 smithi053 bash[21662]: audit 2024-09-15T03:23:03.928261+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:04 smithi053 bash[21662]: audit 2024-09-15T03:23:03.934246+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:04 smithi053 bash[21662]: audit 2024-09-15T03:23:03.940499+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:04 smithi104 bash[15781]: audit 2024-09-15T03:23:03.928261+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:04 smithi104 bash[15781]: audit 2024-09-15T03:23:03.934246+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:04 smithi104 bash[15781]: audit 2024-09-15T03:23:03.940499+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:05.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:05 smithi104 bash[15781]: cluster 2024-09-15T03:23:05.777256+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:06.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:05 smithi053 bash[15077]: cluster 2024-09-15T03:23:05.777256+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:05 smithi053 bash[21662]: cluster 2024-09-15T03:23:05.777256+0000 mgr.y (mgr.14150) 242 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:07 smithi053 bash[15077]: cluster 2024-09-15T03:23:07.777776+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:08.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:07 smithi053 bash[21662]: cluster 2024-09-15T03:23:07.777776+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:08.222 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:07 smithi104 bash[15781]: cluster 2024-09-15T03:23:07.777776+0000 mgr.y (mgr.14150) 243 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:10.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:09 smithi053 bash[15077]: cluster 2024-09-15T03:23:09.778276+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:10.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:09 smithi053 bash[21662]: cluster 2024-09-15T03:23:09.778276+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:10.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:09 smithi104 bash[15781]: cluster 2024-09-15T03:23:09.778276+0000 mgr.y (mgr.14150) 244 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:11.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[15077]: audit 2024-09-15T03:23:10.679179+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.104:0/2153053612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]: dispatch 2024-09-15T03:23:11.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[15077]: audit 2024-09-15T03:23:10.680291+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]: dispatch 2024-09-15T03:23:11.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[15077]: audit 2024-09-15T03:23:10.689280+0000 mon.a (mon.0) 614 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]': finished 2024-09-15T03:23:11.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[15077]: cluster 2024-09-15T03:23:10.689401+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-09-15T03:23:11.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[15077]: audit 2024-09-15T03:23:10.689582+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[21662]: audit 2024-09-15T03:23:10.679179+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.104:0/2153053612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]: dispatch 2024-09-15T03:23:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[21662]: audit 2024-09-15T03:23:10.680291+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]: dispatch 2024-09-15T03:23:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[21662]: audit 2024-09-15T03:23:10.689280+0000 mon.a (mon.0) 614 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]': finished 2024-09-15T03:23:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[21662]: cluster 2024-09-15T03:23:10.689401+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-09-15T03:23:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:10 smithi053 bash[21662]: audit 2024-09-15T03:23:10.689582+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:11.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:10 smithi104 bash[15781]: audit 2024-09-15T03:23:10.679179+0000 mon.b (mon.1) 9 : audit [INF] from='client.? 172.21.15.104:0/2153053612' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]: dispatch 2024-09-15T03:23:11.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:10 smithi104 bash[15781]: audit 2024-09-15T03:23:10.680291+0000 mon.a (mon.0) 613 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]: dispatch 2024-09-15T03:23:11.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:10 smithi104 bash[15781]: audit 2024-09-15T03:23:10.689280+0000 mon.a (mon.0) 614 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "006ec282-23db-4141-b688-4a95655e74a3"}]': finished 2024-09-15T03:23:11.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:10 smithi104 bash[15781]: cluster 2024-09-15T03:23:10.689401+0000 mon.a (mon.0) 615 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2024-09-15T03:23:11.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:10 smithi104 bash[15781]: audit 2024-09-15T03:23:10.689582+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:12.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:11 smithi053 bash[15077]: cluster 2024-09-15T03:23:11.778783+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:11 smithi053 bash[21662]: cluster 2024-09-15T03:23:11.778783+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:12.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:11 smithi104 bash[15781]: cluster 2024-09-15T03:23:11.778783+0000 mgr.y (mgr.14150) 245 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:13.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:12 smithi053 bash[15077]: audit 2024-09-15T03:23:12.273549+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.104:0/1573297555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:23:13.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:12 smithi053 bash[21662]: audit 2024-09-15T03:23:12.273549+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.104:0/1573297555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:23:13.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:12 smithi104 bash[15781]: audit 2024-09-15T03:23:12.273549+0000 mon.b (mon.1) 10 : audit [DBG] from='client.? 172.21.15.104:0/1573297555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:23:14.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:13 smithi053 bash[15077]: cluster 2024-09-15T03:23:13.779297+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:14.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:13 smithi053 bash[21662]: cluster 2024-09-15T03:23:13.779297+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:14.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:13 smithi104 bash[15781]: cluster 2024-09-15T03:23:13.779297+0000 mgr.y (mgr.14150) 246 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:16.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:15 smithi053 bash[15077]: cluster 2024-09-15T03:23:15.779853+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:16.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:15 smithi053 bash[21662]: cluster 2024-09-15T03:23:15.779853+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:16.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:15 smithi104 bash[15781]: cluster 2024-09-15T03:23:15.779853+0000 mgr.y (mgr.14150) 247 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:18.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:17 smithi104 bash[15781]: cluster 2024-09-15T03:23:17.780348+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:18.234 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:17 smithi053 bash[21662]: cluster 2024-09-15T03:23:17.780348+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:18.234 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:17 smithi053 bash[15077]: cluster 2024-09-15T03:23:17.780348+0000 mgr.y (mgr.14150) 248 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:20.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:19 smithi053 bash[15077]: cluster 2024-09-15T03:23:19.780861+0000 mgr.y (mgr.14150) 249 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:19 smithi053 bash[21662]: cluster 2024-09-15T03:23:19.780861+0000 mgr.y (mgr.14150) 249 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:20.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:19 smithi104 bash[15781]: cluster 2024-09-15T03:23:19.780861+0000 mgr.y (mgr.14150) 249 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:22.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:21 smithi053 bash[15077]: cluster 2024-09-15T03:23:21.781410+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:22.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:21 smithi053 bash[21662]: cluster 2024-09-15T03:23:21.781410+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:22.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:21 smithi104 bash[15781]: cluster 2024-09-15T03:23:21.781410+0000 mgr.y (mgr.14150) 250 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:23.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:23 smithi053 bash[15077]: audit 2024-09-15T03:23:22.686236+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:23 smithi053 bash[15077]: audit 2024-09-15T03:23:22.694279+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:23 smithi053 bash[15077]: audit 2024-09-15T03:23:22.701580+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.944 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:23 smithi053 bash[21662]: audit 2024-09-15T03:23:22.686236+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.944 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:23 smithi053 bash[21662]: audit 2024-09-15T03:23:22.694279+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.944 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:23 smithi053 bash[21662]: audit 2024-09-15T03:23:22.701580+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:23 smithi104 bash[15781]: audit 2024-09-15T03:23:22.686236+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:23 smithi104 bash[15781]: audit 2024-09-15T03:23:22.694279+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:23.970 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:23 smithi104 bash[15781]: audit 2024-09-15T03:23:22.701580+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:24.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:24 smithi104 bash[15781]: cluster 2024-09-15T03:23:23.781940+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:24.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:24 smithi104 bash[15781]: audit 2024-09-15T03:23:24.117053+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:24.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:24 smithi104 bash[15781]: audit 2024-09-15T03:23:24.122553+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:24.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:24 smithi104 bash[15781]: audit 2024-09-15T03:23:24.128294+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:25.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[15077]: cluster 2024-09-15T03:23:23.781940+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:25.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[15077]: audit 2024-09-15T03:23:24.117053+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:25.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[15077]: audit 2024-09-15T03:23:24.122553+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:25.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[15077]: audit 2024-09-15T03:23:24.128294+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:25.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[21662]: cluster 2024-09-15T03:23:23.781940+0000 mgr.y (mgr.14150) 251 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:25.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[21662]: audit 2024-09-15T03:23:24.117053+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:25.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[21662]: audit 2024-09-15T03:23:24.122553+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:25.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:24 smithi053 bash[21662]: audit 2024-09-15T03:23:24.128294+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:25.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:25 smithi104 bash[15781]: audit 2024-09-15T03:23:24.736455+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T03:23:25.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:25 smithi104 bash[15781]: audit 2024-09-15T03:23:24.738205+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:25.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:25 smithi104 bash[15781]: cephadm 2024-09-15T03:23:24.739154+0000 mgr.y (mgr.14150) 252 : cephadm [INF] Deploying daemon osd.4 on smithi104 2024-09-15T03:23:26.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:25 smithi053 bash[15077]: audit 2024-09-15T03:23:24.736455+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T03:23:26.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:25 smithi053 bash[15077]: audit 2024-09-15T03:23:24.738205+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:26.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:25 smithi053 bash[15077]: cephadm 2024-09-15T03:23:24.739154+0000 mgr.y (mgr.14150) 252 : cephadm [INF] Deploying daemon osd.4 on smithi104 2024-09-15T03:23:26.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:25 smithi053 bash[21662]: audit 2024-09-15T03:23:24.736455+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T03:23:26.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:25 smithi053 bash[21662]: audit 2024-09-15T03:23:24.738205+0000 mon.a (mon.0) 624 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:26.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:25 smithi053 bash[21662]: cephadm 2024-09-15T03:23:24.739154+0000 mgr.y (mgr.14150) 252 : cephadm [INF] Deploying daemon osd.4 on smithi104 2024-09-15T03:23:26.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:26 smithi104 bash[15781]: cluster 2024-09-15T03:23:25.782494+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:27.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:26 smithi053 bash[15077]: cluster 2024-09-15T03:23:25.782494+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:27.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:26 smithi053 bash[21662]: cluster 2024-09-15T03:23:25.782494+0000 mgr.y (mgr.14150) 253 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:28.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:27 smithi053 bash[15077]: cluster 2024-09-15T03:23:27.783033+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:28.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:27 smithi053 bash[21662]: cluster 2024-09-15T03:23:27.783033+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:28.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:27 smithi104 bash[15781]: cluster 2024-09-15T03:23:27.783033+0000 mgr.y (mgr.14150) 254 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:30.175 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:29 smithi104 bash[15781]: cluster 2024-09-15T03:23:29.783596+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:30.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:29 smithi053 bash[15077]: cluster 2024-09-15T03:23:29.783596+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:30.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:29 smithi053 bash[21662]: cluster 2024-09-15T03:23:29.783596+0000 mgr.y (mgr.14150) 255 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:31.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[15077]: audit 2024-09-15T03:23:30.667649+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:31.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[15077]: audit 2024-09-15T03:23:30.675556+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[15077]: audit 2024-09-15T03:23:30.676007+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[15077]: audit 2024-09-15T03:23:30.677568+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[15077]: audit 2024-09-15T03:23:30.681441+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[15077]: audit 2024-09-15T03:23:30.685751+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[21662]: audit 2024-09-15T03:23:30.667649+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[21662]: audit 2024-09-15T03:23:30.675556+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[21662]: audit 2024-09-15T03:23:30.676007+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[21662]: audit 2024-09-15T03:23:30.677568+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[21662]: audit 2024-09-15T03:23:30.681441+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:30 smithi053 bash[21662]: audit 2024-09-15T03:23:30.685751+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:30 smithi104 bash[15781]: audit 2024-09-15T03:23:30.667649+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:31.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:30 smithi104 bash[15781]: audit 2024-09-15T03:23:30.675556+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:30 smithi104 bash[15781]: audit 2024-09-15T03:23:30.676007+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:30 smithi104 bash[15781]: audit 2024-09-15T03:23:30.677568+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:30 smithi104 bash[15781]: audit 2024-09-15T03:23:30.681441+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:31.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:30 smithi104 bash[15781]: audit 2024-09-15T03:23:30.685751+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:32.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:31 smithi053 bash[15077]: cluster 2024-09-15T03:23:31.784205+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:32.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:31 smithi053 bash[21662]: cluster 2024-09-15T03:23:31.784205+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:32.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:31 smithi104 bash[15781]: cluster 2024-09-15T03:23:31.784205+0000 mgr.y (mgr.14150) 256 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:34.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:33 smithi053 bash[15077]: cluster 2024-09-15T03:23:33.784754+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:34.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:33 smithi053 bash[21662]: cluster 2024-09-15T03:23:33.784754+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:34.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:33 smithi104 bash[15781]: cluster 2024-09-15T03:23:33.784754+0000 mgr.y (mgr.14150) 257 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:36.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:35 smithi053 bash[15077]: cluster 2024-09-15T03:23:35.785410+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:35 smithi053 bash[21662]: cluster 2024-09-15T03:23:35.785410+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:36.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:35 smithi104 bash[15781]: cluster 2024-09-15T03:23:35.785410+0000 mgr.y (mgr.14150) 258 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:38.169 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:37 smithi104 bash[15781]: cluster 2024-09-15T03:23:37.786088+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:38.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:37 smithi053 bash[15077]: cluster 2024-09-15T03:23:37.786088+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:38.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:37 smithi053 bash[21662]: cluster 2024-09-15T03:23:37.786088+0000 mgr.y (mgr.14150) 259 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:39.171 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:38 smithi104 bash[15781]: audit 2024-09-15T03:23:38.842141+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T03:23:39.172 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:38 smithi104 bash[15781]: audit 2024-09-15T03:23:38.843116+0000 mon.a (mon.0) 631 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T03:23:39.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:38 smithi053 bash[15077]: audit 2024-09-15T03:23:38.842141+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T03:23:39.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:38 smithi053 bash[15077]: audit 2024-09-15T03:23:38.843116+0000 mon.a (mon.0) 631 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T03:23:39.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:38 smithi053 bash[21662]: audit 2024-09-15T03:23:38.842141+0000 mon.b (mon.1) 11 : audit [INF] from='osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T03:23:39.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:38 smithi053 bash[21662]: audit 2024-09-15T03:23:38.843116+0000 mon.a (mon.0) 631 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T03:23:40.173 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:39 smithi104 bash[15781]: audit 2024-09-15T03:23:38.890507+0000 mon.a (mon.0) 632 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T03:23:40.173 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:39 smithi104 bash[15781]: cluster 2024-09-15T03:23:38.890585+0000 mon.a (mon.0) 633 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-15T03:23:40.173 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:39 smithi104 bash[15781]: audit 2024-09-15T03:23:38.890817+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:40.173 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:39 smithi104 bash[15781]: audit 2024-09-15T03:23:38.892146+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:23:40.173 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:39 smithi104 bash[15781]: audit 2024-09-15T03:23:38.893040+0000 mon.a (mon.0) 635 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:23:40.173 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:39 smithi104 bash[15781]: cluster 2024-09-15T03:23:39.786619+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:40.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[15077]: audit 2024-09-15T03:23:38.890507+0000 mon.a (mon.0) 632 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[15077]: cluster 2024-09-15T03:23:38.890585+0000 mon.a (mon.0) 633 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[15077]: audit 2024-09-15T03:23:38.890817+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[15077]: audit 2024-09-15T03:23:38.892146+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[15077]: audit 2024-09-15T03:23:38.893040+0000 mon.a (mon.0) 635 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[15077]: cluster 2024-09-15T03:23:39.786619+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[21662]: audit 2024-09-15T03:23:38.890507+0000 mon.a (mon.0) 632 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[21662]: cluster 2024-09-15T03:23:38.890585+0000 mon.a (mon.0) 633 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2024-09-15T03:23:40.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[21662]: audit 2024-09-15T03:23:38.890817+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:40.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[21662]: audit 2024-09-15T03:23:38.892146+0000 mon.b (mon.1) 12 : audit [INF] from='osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:23:40.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[21662]: audit 2024-09-15T03:23:38.893040+0000 mon.a (mon.0) 635 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:23:40.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:39 smithi053 bash[21662]: cluster 2024-09-15T03:23:39.786619+0000 mgr.y (mgr.14150) 260 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-15T03:23:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:40 smithi104 bash[15781]: audit 2024-09-15T03:23:39.895429+0000 mon.a (mon.0) 636 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:23:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:40 smithi104 bash[15781]: cluster 2024-09-15T03:23:39.895624+0000 mon.a (mon.0) 637 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-15T03:23:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:40 smithi104 bash[15781]: audit 2024-09-15T03:23:39.896248+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:40 smithi104 bash[15781]: audit 2024-09-15T03:23:39.902585+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:40.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:40 smithi104 bash[15781]: cluster 2024-09-15T03:23:40.895722+0000 mon.a (mon.0) 640 : cluster [INF] osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825] boot 2024-09-15T03:23:40.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:40 smithi104 bash[15781]: cluster 2024-09-15T03:23:40.895790+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-09-15T03:23:40.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:40 smithi104 bash[15781]: audit 2024-09-15T03:23:40.896100+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:41.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[15077]: audit 2024-09-15T03:23:39.895429+0000 mon.a (mon.0) 636 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[15077]: cluster 2024-09-15T03:23:39.895624+0000 mon.a (mon.0) 637 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[15077]: audit 2024-09-15T03:23:39.896248+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[15077]: audit 2024-09-15T03:23:39.902585+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[15077]: cluster 2024-09-15T03:23:40.895722+0000 mon.a (mon.0) 640 : cluster [INF] osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825] boot 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[15077]: cluster 2024-09-15T03:23:40.895790+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[15077]: audit 2024-09-15T03:23:40.896100+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[21662]: audit 2024-09-15T03:23:39.895429+0000 mon.a (mon.0) 636 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:23:41.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[21662]: cluster 2024-09-15T03:23:39.895624+0000 mon.a (mon.0) 637 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-09-15T03:23:41.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[21662]: audit 2024-09-15T03:23:39.896248+0000 mon.a (mon.0) 638 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:41.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[21662]: audit 2024-09-15T03:23:39.902585+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:41.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[21662]: cluster 2024-09-15T03:23:40.895722+0000 mon.a (mon.0) 640 : cluster [INF] osd.4 [v2:172.21.15.104:6800/3793887825,v1:172.21.15.104:6801/3793887825] boot 2024-09-15T03:23:41.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[21662]: cluster 2024-09-15T03:23:40.895790+0000 mon.a (mon.0) 641 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2024-09-15T03:23:41.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:40 smithi053 bash[21662]: audit 2024-09-15T03:23:40.896100+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:23:41.524 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 4 on host 'smithi104' 2024-09-15T03:23:41.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: cluster 2024-09-15T03:23:39.862518+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:23:41.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: cluster 2024-09-15T03:23:39.862592+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:23:41.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.509245+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:41.913 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.515578+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.515930+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: cephadm 2024-09-15T03:23:41.518537+0000 mgr.y (mgr.14150) 261 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 16241M 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.521830+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.526075+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.527302+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.528215+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: audit 2024-09-15T03:23:41.533589+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:41.914 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[15077]: cluster 2024-09-15T03:23:41.787163+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v222: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: cluster 2024-09-15T03:23:39.862518+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: cluster 2024-09-15T03:23:39.862592+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.509245+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.515578+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.515930+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: cephadm 2024-09-15T03:23:41.518537+0000 mgr.y (mgr.14150) 261 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 16241M 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.521830+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.526075+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.527302+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.528215+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: audit 2024-09-15T03:23:41.533589+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:41 smithi053 bash[21662]: cluster 2024-09-15T03:23:41.787163+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v222: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:42.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: cluster 2024-09-15T03:23:39.862518+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:23:42.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: cluster 2024-09-15T03:23:39.862592+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:23:42.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.509245+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:42.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.515578+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.515930+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: cephadm 2024-09-15T03:23:41.518537+0000 mgr.y (mgr.14150) 261 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 16241M 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.521830+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.526075+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.527302+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.528215+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: audit 2024-09-15T03:23:41.533589+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:41 smithi104 bash[15781]: cluster 2024-09-15T03:23:41.787163+0000 mgr.y (mgr.14150) 262 : cluster [DBG] pgmap v222: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:42.248 DEBUG:teuthology.orchestra.run.smithi104:osd.4> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T03:23:42.251 INFO:tasks.cephadm:Deploying osd.5 on smithi104 with /dev/nvme3n1... 2024-09-15T03:23:42.251 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme3n1 2024-09-15T03:23:42.373 INFO:journalctl@ceph.osd.4.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:23:43.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:42 smithi053 bash[15077]: cluster 2024-09-15T03:23:41.907992+0000 mon.a (mon.0) 651 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-15T03:23:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:42 smithi053 bash[15077]: audit 2024-09-15T03:23:42.905012+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:42 smithi053 bash[15077]: cluster 2024-09-15T03:23:42.911200+0000 mon.a (mon.0) 653 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-15T03:23:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:42 smithi053 bash[21662]: cluster 2024-09-15T03:23:41.907992+0000 mon.a (mon.0) 651 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-15T03:23:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:42 smithi053 bash[21662]: audit 2024-09-15T03:23:42.905012+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:42 smithi053 bash[21662]: cluster 2024-09-15T03:23:42.911200+0000 mon.a (mon.0) 653 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-15T03:23:43.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:42 smithi104 bash[15781]: cluster 2024-09-15T03:23:41.907992+0000 mon.a (mon.0) 651 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-09-15T03:23:43.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:42 smithi104 bash[15781]: audit 2024-09-15T03:23:42.905012+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:43.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:42 smithi104 bash[15781]: cluster 2024-09-15T03:23:42.911200+0000 mon.a (mon.0) 653 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-09-15T03:23:44.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:43 smithi053 bash[15077]: audit 2024-09-15T03:23:42.917460+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:44.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:43 smithi053 bash[15077]: audit 2024-09-15T03:23:42.928127+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:43 smithi053 bash[15077]: cluster 2024-09-15T03:23:43.787650+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v225: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:43 smithi053 bash[21662]: audit 2024-09-15T03:23:42.917460+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:43 smithi053 bash[21662]: audit 2024-09-15T03:23:42.928127+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:43 smithi053 bash[21662]: cluster 2024-09-15T03:23:43.787650+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v225: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:44.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:43 smithi104 bash[15781]: audit 2024-09-15T03:23:42.917460+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:44.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:43 smithi104 bash[15781]: audit 2024-09-15T03:23:42.928127+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:43 smithi104 bash[15781]: cluster 2024-09-15T03:23:43.787650+0000 mgr.y (mgr.14150) 263 : cluster [DBG] pgmap v225: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:45.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: cluster 2024-09-15T03:23:43.935895+0000 mon.a (mon.0) 656 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: audit 2024-09-15T03:23:44.309058+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: audit 2024-09-15T03:23:44.314402+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: cephadm 2024-09-15T03:23:44.316807+0000 mgr.y (mgr.14150) 264 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: audit 2024-09-15T03:23:44.318448+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: audit 2024-09-15T03:23:44.323288+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: audit 2024-09-15T03:23:44.323662+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: audit 2024-09-15T03:23:44.325115+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: cluster 2024-09-15T03:23:44.327923+0000 mgr.y (mgr.14150) 265 : cluster [DBG] pgmap v227: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:45.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[15077]: audit 2024-09-15T03:23:44.332009+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: cluster 2024-09-15T03:23:43.935895+0000 mon.a (mon.0) 656 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: audit 2024-09-15T03:23:44.309058+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: audit 2024-09-15T03:23:44.314402+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: cephadm 2024-09-15T03:23:44.316807+0000 mgr.y (mgr.14150) 264 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: audit 2024-09-15T03:23:44.318448+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: audit 2024-09-15T03:23:44.323288+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: audit 2024-09-15T03:23:44.323662+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: audit 2024-09-15T03:23:44.325115+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: cluster 2024-09-15T03:23:44.327923+0000 mgr.y (mgr.14150) 265 : cluster [DBG] pgmap v227: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:45.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:44 smithi053 bash[21662]: audit 2024-09-15T03:23:44.332009+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: cluster 2024-09-15T03:23:43.935895+0000 mon.a (mon.0) 656 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: audit 2024-09-15T03:23:44.309058+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: audit 2024-09-15T03:23:44.314402+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: cephadm 2024-09-15T03:23:44.316807+0000 mgr.y (mgr.14150) 264 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: audit 2024-09-15T03:23:44.318448+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: audit 2024-09-15T03:23:44.323288+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: audit 2024-09-15T03:23:44.323662+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: audit 2024-09-15T03:23:44.325115+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: cluster 2024-09-15T03:23:44.327923+0000 mgr.y (mgr.14150) 265 : cluster [DBG] pgmap v227: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:44 smithi104 bash[15781]: audit 2024-09-15T03:23:44.332009+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:46.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:45 smithi104 bash[15781]: cluster 2024-09-15T03:23:44.946978+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-15T03:23:46.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:45 smithi104 bash[15781]: cluster 2024-09-15T03:23:45.319479+0000 mon.a (mon.0) 665 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:23:46.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:45 smithi053 bash[15077]: cluster 2024-09-15T03:23:44.946978+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-15T03:23:46.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:45 smithi053 bash[15077]: cluster 2024-09-15T03:23:45.319479+0000 mon.a (mon.0) 665 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:23:46.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:45 smithi053 bash[21662]: cluster 2024-09-15T03:23:44.946978+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e34: 5 total, 5 up, 5 in 2024-09-15T03:23:46.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:45 smithi053 bash[21662]: cluster 2024-09-15T03:23:45.319479+0000 mon.a (mon.0) 665 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-09-15T03:23:47.030 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:23:47.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:46 smithi104 bash[15781]: cluster 2024-09-15T03:23:46.328494+0000 mgr.y (mgr.14150) 266 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-15T03:23:47.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:46 smithi053 bash[15077]: cluster 2024-09-15T03:23:46.328494+0000 mgr.y (mgr.14150) 266 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-15T03:23:47.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:46 smithi053 bash[21662]: cluster 2024-09-15T03:23:46.328494+0000 mgr.y (mgr.14150) 266 : cluster [DBG] pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-09-15T03:23:49.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:49 smithi053 bash[15077]: cluster 2024-09-15T03:23:48.329127+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-15T03:23:49.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:49 smithi053 bash[21662]: cluster 2024-09-15T03:23:48.329127+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-15T03:23:49.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:49 smithi104 bash[15781]: cluster 2024-09-15T03:23:48.329127+0000 mgr.y (mgr.14150) 267 : cluster [DBG] pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-15T03:23:51.603 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/nvme3n1 2024-09-15T03:23:51.603 INFO:teuthology.orchestra.run.smithi104.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:23:51.609 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme3n1 bs=1M count=10 conv=fsync 2024-09-15T03:23:51.626 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-09-15T03:23:51.627 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-09-15T03:23:51.627 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0151855 s, 691 MB/s 2024-09-15T03:23:51.627 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-09-15T03:23:51.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: cluster 2024-09-15T03:23:50.329785+0000 mgr.y (mgr.14150) 268 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: audit 2024-09-15T03:23:50.629980+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: audit 2024-09-15T03:23:50.635378+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: audit 2024-09-15T03:23:50.638890+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: audit 2024-09-15T03:23:50.643382+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: audit 2024-09-15T03:23:50.643670+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: audit 2024-09-15T03:23:50.645366+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: cluster 2024-09-15T03:23:50.647611+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[15077]: audit 2024-09-15T03:23:50.652139+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: cluster 2024-09-15T03:23:50.329785+0000 mgr.y (mgr.14150) 268 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: audit 2024-09-15T03:23:50.629980+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: audit 2024-09-15T03:23:50.635378+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: audit 2024-09-15T03:23:50.638890+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: audit 2024-09-15T03:23:50.643382+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: audit 2024-09-15T03:23:50.643670+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: audit 2024-09-15T03:23:50.645366+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: cluster 2024-09-15T03:23:50.647611+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-15T03:23:51.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:51 smithi053 bash[21662]: audit 2024-09-15T03:23:50.652139+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: cluster 2024-09-15T03:23:50.329785+0000 mgr.y (mgr.14150) 268 : cluster [DBG] pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: audit 2024-09-15T03:23:50.629980+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: audit 2024-09-15T03:23:50.635378+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: audit 2024-09-15T03:23:50.638890+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: audit 2024-09-15T03:23:50.643382+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: audit 2024-09-15T03:23:50.643670+0000 mon.a (mon.0) 670 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: audit 2024-09-15T03:23:50.645366+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: cluster 2024-09-15T03:23:50.647611+0000 mgr.y (mgr.14150) 269 : cluster [DBG] pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-09-15T03:23:51.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:51 smithi104 bash[15781]: audit 2024-09-15T03:23:50.652139+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:23:52.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:52 smithi053 bash[15077]: cluster 2024-09-15T03:23:51.639881+0000 mon.a (mon.0) 673 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:23:52.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:52 smithi053 bash[15077]: cluster 2024-09-15T03:23:51.639910+0000 mon.a (mon.0) 674 : cluster [INF] Cluster is now healthy 2024-09-15T03:23:52.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:52 smithi053 bash[21662]: cluster 2024-09-15T03:23:51.639881+0000 mon.a (mon.0) 673 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:23:52.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:52 smithi053 bash[21662]: cluster 2024-09-15T03:23:51.639910+0000 mon.a (mon.0) 674 : cluster [INF] Cluster is now healthy 2024-09-15T03:23:52.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:52 smithi104 bash[15781]: cluster 2024-09-15T03:23:51.639881+0000 mon.a (mon.0) 673 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-09-15T03:23:52.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:52 smithi104 bash[15781]: cluster 2024-09-15T03:23:51.639910+0000 mon.a (mon.0) 674 : cluster [INF] Cluster is now healthy 2024-09-15T03:23:53.076 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi104:/dev/nvme3n1 2024-09-15T03:23:53.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:53 smithi053 bash[15077]: cluster 2024-09-15T03:23:52.648130+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T03:23:53.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:53 smithi053 bash[21662]: cluster 2024-09-15T03:23:52.648130+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T03:23:53.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:53 smithi104 bash[15781]: cluster 2024-09-15T03:23:52.648130+0000 mgr.y (mgr.14150) 270 : cluster [DBG] pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T03:23:55.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:55 smithi104 bash[15781]: cluster 2024-09-15T03:23:54.648760+0000 mgr.y (mgr.14150) 271 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T03:23:56.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:55 smithi053 bash[15077]: cluster 2024-09-15T03:23:54.648760+0000 mgr.y (mgr.14150) 271 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T03:23:56.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:55 smithi053 bash[21662]: cluster 2024-09-15T03:23:54.648760+0000 mgr.y (mgr.14150) 271 : cluster [DBG] pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T03:23:57.809 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:23:57.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:57 smithi104 bash[15781]: cluster 2024-09-15T03:23:56.649386+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:58.066 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:57 smithi053 bash[21662]: cluster 2024-09-15T03:23:56.649386+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:58.067 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:57 smithi053 bash[15077]: cluster 2024-09-15T03:23:56.649386+0000 mgr.y (mgr.14150) 272 : cluster [DBG] pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:23:59.978 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:23:59 smithi104 bash[15781]: cluster 2024-09-15T03:23:58.650072+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:00.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:23:59 smithi053 bash[15077]: cluster 2024-09-15T03:23:58.650072+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:00.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:23:59 smithi053 bash[21662]: cluster 2024-09-15T03:23:58.650072+0000 mgr.y (mgr.14150) 273 : cluster [DBG] pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:01.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:01 smithi104 bash[15781]: cluster 2024-09-15T03:24:00.650619+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:01.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:01 smithi104 bash[15781]: audit 2024-09-15T03:24:01.399130+0000 mon.a (mon.0) 675 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:24:01.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:01 smithi104 bash[15781]: audit 2024-09-15T03:24:01.405039+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:24:01.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:01 smithi104 bash[15781]: audit 2024-09-15T03:24:01.406135+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:02.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[15077]: cluster 2024-09-15T03:24:00.650619+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[15077]: audit 2024-09-15T03:24:01.399130+0000 mon.a (mon.0) 675 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:24:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[15077]: audit 2024-09-15T03:24:01.405039+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:24:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[15077]: audit 2024-09-15T03:24:01.406135+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:02.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[21662]: cluster 2024-09-15T03:24:00.650619+0000 mgr.y (mgr.14150) 274 : cluster [DBG] pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:02.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[21662]: audit 2024-09-15T03:24:01.399130+0000 mon.a (mon.0) 675 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:24:02.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[21662]: audit 2024-09-15T03:24:01.405039+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:24:02.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:01 smithi053 bash[21662]: audit 2024-09-15T03:24:01.406135+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:02.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:02 smithi104 bash[15781]: audit 2024-09-15T03:24:01.392831+0000 mgr.y (mgr.14150) 275 : audit [DBG] from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:24:03.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:02 smithi053 bash[15077]: audit 2024-09-15T03:24:01.392831+0000 mgr.y (mgr.14150) 275 : audit [DBG] from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:24:03.154 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:02 smithi053 bash[21662]: audit 2024-09-15T03:24:01.392831+0000 mgr.y (mgr.14150) 275 : audit [DBG] from='client.24253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:24:03.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:03 smithi104 bash[15781]: cluster 2024-09-15T03:24:02.651158+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:03.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:03 smithi104 bash[15781]: audit 2024-09-15T03:24:03.136463+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:03.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:03 smithi104 bash[15781]: audit 2024-09-15T03:24:03.143693+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:03.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:03 smithi104 bash[15781]: audit 2024-09-15T03:24:03.151265+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[15077]: cluster 2024-09-15T03:24:02.651158+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[15077]: audit 2024-09-15T03:24:03.136463+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[15077]: audit 2024-09-15T03:24:03.143693+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:04.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[15077]: audit 2024-09-15T03:24:03.151265+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[21662]: cluster 2024-09-15T03:24:02.651158+0000 mgr.y (mgr.14150) 276 : cluster [DBG] pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[21662]: audit 2024-09-15T03:24:03.136463+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[21662]: audit 2024-09-15T03:24:03.143693+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:03 smithi053 bash[21662]: audit 2024-09-15T03:24:03.151265+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:06.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:05 smithi053 bash[15077]: cluster 2024-09-15T03:24:04.651637+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:05 smithi053 bash[21662]: cluster 2024-09-15T03:24:04.651637+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:06.232 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:05 smithi104 bash[15781]: cluster 2024-09-15T03:24:04.651637+0000 mgr.y (mgr.14150) 277 : cluster [DBG] pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:07.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:07 smithi104 bash[15781]: cluster 2024-09-15T03:24:06.652265+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:08.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:07 smithi053 bash[15077]: cluster 2024-09-15T03:24:06.652265+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:08.394 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:07 smithi053 bash[21662]: cluster 2024-09-15T03:24:06.652265+0000 mgr.y (mgr.14150) 278 : cluster [DBG] pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:10.158 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:09 smithi104 bash[15781]: cluster 2024-09-15T03:24:08.652791+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:10.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:09 smithi053 bash[15077]: cluster 2024-09-15T03:24:08.652791+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:10.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:09 smithi053 bash[21662]: cluster 2024-09-15T03:24:08.652791+0000 mgr.y (mgr.14150) 279 : cluster [DBG] pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: audit 2024-09-15T03:24:10.279685+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: audit 2024-09-15T03:24:10.285710+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: audit 2024-09-15T03:24:10.292192+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: cluster 2024-09-15T03:24:10.653336+0000 mgr.y (mgr.14150) 280 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: audit 2024-09-15T03:24:10.809429+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.104:0/1298971098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]: dispatch 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: audit 2024-09-15T03:24:10.810937+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]: dispatch 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: audit 2024-09-15T03:24:10.818228+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]': finished 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: cluster 2024-09-15T03:24:10.818334+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-15T03:24:11.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:11 smithi104 bash[15781]: audit 2024-09-15T03:24:10.818614+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: audit 2024-09-15T03:24:10.279685+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: audit 2024-09-15T03:24:10.285710+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: audit 2024-09-15T03:24:10.292192+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: cluster 2024-09-15T03:24:10.653336+0000 mgr.y (mgr.14150) 280 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: audit 2024-09-15T03:24:10.809429+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.104:0/1298971098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]: dispatch 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: audit 2024-09-15T03:24:10.810937+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]: dispatch 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: audit 2024-09-15T03:24:10.818228+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]': finished 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: cluster 2024-09-15T03:24:10.818334+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-15T03:24:11.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[15077]: audit 2024-09-15T03:24:10.818614+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: audit 2024-09-15T03:24:10.279685+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: audit 2024-09-15T03:24:10.285710+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: audit 2024-09-15T03:24:10.292192+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: cluster 2024-09-15T03:24:10.653336+0000 mgr.y (mgr.14150) 280 : cluster [DBG] pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: audit 2024-09-15T03:24:10.809429+0000 mon.b (mon.1) 13 : audit [INF] from='client.? 172.21.15.104:0/1298971098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]: dispatch 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: audit 2024-09-15T03:24:10.810937+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]: dispatch 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: audit 2024-09-15T03:24:10.818228+0000 mon.a (mon.0) 685 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cb3c0d1-577c-4dcc-aa8a-543858692116"}]': finished 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: cluster 2024-09-15T03:24:10.818334+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-09-15T03:24:11.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:11 smithi053 bash[21662]: audit 2024-09-15T03:24:10.818614+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:12.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:12 smithi104 bash[15781]: audit 2024-09-15T03:24:12.386376+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.104:0/20842681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:24:12.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:12 smithi053 bash[15077]: audit 2024-09-15T03:24:12.386376+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.104:0/20842681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:24:12.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:12 smithi053 bash[21662]: audit 2024-09-15T03:24:12.386376+0000 mon.b (mon.1) 14 : audit [DBG] from='client.? 172.21.15.104:0/20842681' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:24:13.732 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:13 smithi104 bash[15781]: cluster 2024-09-15T03:24:12.653866+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:13.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:13 smithi053 bash[15077]: cluster 2024-09-15T03:24:12.653866+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:13.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:13 smithi053 bash[21662]: cluster 2024-09-15T03:24:12.653866+0000 mgr.y (mgr.14150) 281 : cluster [DBG] pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:15.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:15 smithi104 bash[15781]: cluster 2024-09-15T03:24:14.654400+0000 mgr.y (mgr.14150) 282 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:16.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:15 smithi053 bash[15077]: cluster 2024-09-15T03:24:14.654400+0000 mgr.y (mgr.14150) 282 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:16.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:15 smithi053 bash[21662]: cluster 2024-09-15T03:24:14.654400+0000 mgr.y (mgr.14150) 282 : cluster [DBG] pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:17.969 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:17 smithi104 bash[15781]: cluster 2024-09-15T03:24:16.654951+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:18.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:17 smithi053 bash[15077]: cluster 2024-09-15T03:24:16.654951+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:18.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:17 smithi053 bash[21662]: cluster 2024-09-15T03:24:16.654951+0000 mgr.y (mgr.14150) 283 : cluster [DBG] pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:19.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:19 smithi104 bash[15781]: cluster 2024-09-15T03:24:18.655477+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:20.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:19 smithi053 bash[15077]: cluster 2024-09-15T03:24:18.655477+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:19 smithi053 bash[21662]: cluster 2024-09-15T03:24:18.655477+0000 mgr.y (mgr.14150) 284 : cluster [DBG] pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:21.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:21 smithi104 bash[15781]: cluster 2024-09-15T03:24:20.656011+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:22.089 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:21 smithi053 bash[21662]: cluster 2024-09-15T03:24:20.656011+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:22.089 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:21 smithi053 bash[15077]: cluster 2024-09-15T03:24:20.656011+0000 mgr.y (mgr.14150) 285 : cluster [DBG] pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:23.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:23 smithi104 bash[15781]: cluster 2024-09-15T03:24:22.656579+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:23.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:23 smithi104 bash[15781]: audit 2024-09-15T03:24:23.356585+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:23.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:23 smithi104 bash[15781]: audit 2024-09-15T03:24:23.363646+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:23.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:23 smithi104 bash[15781]: audit 2024-09-15T03:24:23.370575+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:24.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[15077]: cluster 2024-09-15T03:24:22.656579+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:24.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[15077]: audit 2024-09-15T03:24:23.356585+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:24.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[15077]: audit 2024-09-15T03:24:23.363646+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:24.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[15077]: audit 2024-09-15T03:24:23.370575+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:24.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[21662]: cluster 2024-09-15T03:24:22.656579+0000 mgr.y (mgr.14150) 286 : cluster [DBG] pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:24.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[21662]: audit 2024-09-15T03:24:23.356585+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:24.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[21662]: audit 2024-09-15T03:24:23.363646+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:24.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:23 smithi053 bash[21662]: audit 2024-09-15T03:24:23.370575+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:25.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:25 smithi104 bash[15781]: cluster 2024-09-15T03:24:24.657115+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:25.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:25 smithi104 bash[15781]: audit 2024-09-15T03:24:25.487751+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T03:24:25.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:25 smithi104 bash[15781]: audit 2024-09-15T03:24:25.489540+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:26.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:25 smithi053 bash[15077]: cluster 2024-09-15T03:24:24.657115+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:26.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:25 smithi053 bash[15077]: audit 2024-09-15T03:24:25.487751+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T03:24:26.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:25 smithi053 bash[15077]: audit 2024-09-15T03:24:25.489540+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:26.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:25 smithi053 bash[21662]: cluster 2024-09-15T03:24:24.657115+0000 mgr.y (mgr.14150) 287 : cluster [DBG] pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:26.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:25 smithi053 bash[21662]: audit 2024-09-15T03:24:25.487751+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T03:24:26.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:25 smithi053 bash[21662]: audit 2024-09-15T03:24:25.489540+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:27.080 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:26 smithi104 bash[15781]: cephadm 2024-09-15T03:24:25.491071+0000 mgr.y (mgr.14150) 288 : cephadm [INF] Deploying daemon osd.5 on smithi104 2024-09-15T03:24:27.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:26 smithi053 bash[15077]: cephadm 2024-09-15T03:24:25.491071+0000 mgr.y (mgr.14150) 288 : cephadm [INF] Deploying daemon osd.5 on smithi104 2024-09-15T03:24:27.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:26 smithi053 bash[21662]: cephadm 2024-09-15T03:24:25.491071+0000 mgr.y (mgr.14150) 288 : cephadm [INF] Deploying daemon osd.5 on smithi104 2024-09-15T03:24:28.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:27 smithi053 bash[15077]: cluster 2024-09-15T03:24:26.657665+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:28.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:27 smithi053 bash[21662]: cluster 2024-09-15T03:24:26.657665+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:28.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:27 smithi104 bash[15781]: cluster 2024-09-15T03:24:26.657665+0000 mgr.y (mgr.14150) 289 : cluster [DBG] pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:30.080 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:29 smithi104 bash[15781]: cluster 2024-09-15T03:24:28.658192+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:30.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:29 smithi053 bash[15077]: cluster 2024-09-15T03:24:28.658192+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:30.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:29 smithi053 bash[21662]: cluster 2024-09-15T03:24:28.658192+0000 mgr.y (mgr.14150) 290 : cluster [DBG] pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.482163+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.487906+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: cephadm 2024-09-15T03:24:30.489952+0000 mgr.y (mgr.14150) 291 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.494748+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.570682+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.578591+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.578950+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.580702+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.584293+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: audit 2024-09-15T03:24:30.590138+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:31 smithi104 bash[15781]: cluster 2024-09-15T03:24:30.658623+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.482163+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.487906+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: cephadm 2024-09-15T03:24:30.489952+0000 mgr.y (mgr.14150) 291 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.494748+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.570682+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.578591+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.578950+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.580702+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:24:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.584293+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: audit 2024-09-15T03:24:30.590138+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[21662]: cluster 2024-09-15T03:24:30.658623+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.482163+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.487906+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: cephadm 2024-09-15T03:24:30.489952+0000 mgr.y (mgr.14150) 291 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.494748+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.570682+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.578591+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.578950+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.580702+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:24:31.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.584293+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: audit 2024-09-15T03:24:30.590138+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:31.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:31 smithi053 bash[15077]: cluster 2024-09-15T03:24:30.658623+0000 mgr.y (mgr.14150) 292 : cluster [DBG] pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:33 smithi104 bash[15781]: cluster 2024-09-15T03:24:32.659129+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:34.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:33 smithi053 bash[21662]: cluster 2024-09-15T03:24:32.659129+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:34.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:33 smithi053 bash[15077]: cluster 2024-09-15T03:24:32.659129+0000 mgr.y (mgr.14150) 293 : cluster [DBG] pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:35.912 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:35 smithi104 bash[15781]: cluster 2024-09-15T03:24:34.659656+0000 mgr.y (mgr.14150) 294 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:35.912 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:35 smithi104 bash[15781]: audit 2024-09-15T03:24:34.995959+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:35.913 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:35 smithi104 bash[15781]: audit 2024-09-15T03:24:35.001924+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:35.913 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:35 smithi104 bash[15781]: audit 2024-09-15T03:24:35.008819+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[21662]: cluster 2024-09-15T03:24:34.659656+0000 mgr.y (mgr.14150) 294 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[21662]: audit 2024-09-15T03:24:34.995959+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[21662]: audit 2024-09-15T03:24:35.001924+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[21662]: audit 2024-09-15T03:24:35.008819+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:36.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[15077]: cluster 2024-09-15T03:24:34.659656+0000 mgr.y (mgr.14150) 294 : cluster [DBG] pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:36.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[15077]: audit 2024-09-15T03:24:34.995959+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:36.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[15077]: audit 2024-09-15T03:24:35.001924+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:36.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:35 smithi053 bash[15077]: audit 2024-09-15T03:24:35.008819+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:38.140 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:37 smithi104 bash[15781]: cluster 2024-09-15T03:24:36.660199+0000 mgr.y (mgr.14150) 295 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:38.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:37 smithi053 bash[21662]: cluster 2024-09-15T03:24:36.660199+0000 mgr.y (mgr.14150) 295 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:37 smithi053 bash[15077]: cluster 2024-09-15T03:24:36.660199+0000 mgr.y (mgr.14150) 295 : cluster [DBG] pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:39.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:39 smithi053 bash[15077]: cluster 2024-09-15T03:24:38.660746+0000 mgr.y (mgr.14150) 296 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:39.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:39 smithi053 bash[15077]: audit 2024-09-15T03:24:39.256363+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T03:24:39.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:39 smithi053 bash[15077]: audit 2024-09-15T03:24:39.257757+0000 mon.a (mon.0) 705 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T03:24:39.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:39 smithi053 bash[21662]: cluster 2024-09-15T03:24:38.660746+0000 mgr.y (mgr.14150) 296 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:39.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:39 smithi053 bash[21662]: audit 2024-09-15T03:24:39.256363+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T03:24:39.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:39 smithi053 bash[21662]: audit 2024-09-15T03:24:39.257757+0000 mon.a (mon.0) 705 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T03:24:39.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:39 smithi104 bash[15781]: cluster 2024-09-15T03:24:38.660746+0000 mgr.y (mgr.14150) 296 : cluster [DBG] pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:39.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:39 smithi104 bash[15781]: audit 2024-09-15T03:24:39.256363+0000 mon.b (mon.1) 15 : audit [INF] from='osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T03:24:39.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:39 smithi104 bash[15781]: audit 2024-09-15T03:24:39.257757+0000 mon.a (mon.0) 705 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T03:24:41.177 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:40 smithi104 bash[15781]: audit 2024-09-15T03:24:39.826158+0000 mon.a (mon.0) 706 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T03:24:41.177 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:40 smithi104 bash[15781]: cluster 2024-09-15T03:24:39.826264+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-15T03:24:41.177 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:40 smithi104 bash[15781]: audit 2024-09-15T03:24:39.826412+0000 mon.a (mon.0) 708 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:41.177 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:40 smithi104 bash[15781]: audit 2024-09-15T03:24:39.826623+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:24:41.178 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:40 smithi104 bash[15781]: audit 2024-09-15T03:24:39.827742+0000 mon.a (mon.0) 709 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:24:41.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[15077]: audit 2024-09-15T03:24:39.826158+0000 mon.a (mon.0) 706 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[15077]: cluster 2024-09-15T03:24:39.826264+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[15077]: audit 2024-09-15T03:24:39.826412+0000 mon.a (mon.0) 708 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[15077]: audit 2024-09-15T03:24:39.826623+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[15077]: audit 2024-09-15T03:24:39.827742+0000 mon.a (mon.0) 709 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[21662]: audit 2024-09-15T03:24:39.826158+0000 mon.a (mon.0) 706 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[21662]: cluster 2024-09-15T03:24:39.826264+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[21662]: audit 2024-09-15T03:24:39.826412+0000 mon.a (mon.0) 708 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[21662]: audit 2024-09-15T03:24:39.826623+0000 mon.b (mon.1) 16 : audit [INF] from='osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:24:41.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:40 smithi053 bash[21662]: audit 2024-09-15T03:24:39.827742+0000 mon.a (mon.0) 709 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:24:42.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[15077]: cluster 2024-09-15T03:24:40.661408+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[15077]: audit 2024-09-15T03:24:40.830329+0000 mon.a (mon.0) 710 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[15077]: cluster 2024-09-15T03:24:40.830574+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[15077]: audit 2024-09-15T03:24:40.831309+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[15077]: audit 2024-09-15T03:24:40.837928+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[21662]: cluster 2024-09-15T03:24:40.661408+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[21662]: audit 2024-09-15T03:24:40.830329+0000 mon.a (mon.0) 710 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[21662]: cluster 2024-09-15T03:24:40.830574+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-15T03:24:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[21662]: audit 2024-09-15T03:24:40.831309+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:42.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:41 smithi053 bash[21662]: audit 2024-09-15T03:24:40.837928+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:41 smithi104 bash[15781]: cluster 2024-09-15T03:24:40.661408+0000 mgr.y (mgr.14150) 297 : cluster [DBG] pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-15T03:24:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:41 smithi104 bash[15781]: audit 2024-09-15T03:24:40.830329+0000 mon.a (mon.0) 710 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:24:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:41 smithi104 bash[15781]: cluster 2024-09-15T03:24:40.830574+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e37: 6 total, 5 up, 6 in 2024-09-15T03:24:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:41 smithi104 bash[15781]: audit 2024-09-15T03:24:40.831309+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:42.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:41 smithi104 bash[15781]: audit 2024-09-15T03:24:40.837928+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:42.447 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 5 on host 'smithi104' 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: cluster 2024-09-15T03:24:40.303714+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: cluster 2024-09-15T03:24:40.303801+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: cluster 2024-09-15T03:24:41.832998+0000 mon.a (mon.0) 714 : cluster [INF] osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730] boot 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: cluster 2024-09-15T03:24:41.833077+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:41.833278+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.429303+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.438154+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:42.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.438534+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:24:42.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.440479+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:24:42.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.445191+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:42.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.454153+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:42.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.456151+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:42.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.457645+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:24:42.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:42 smithi104 bash[15781]: audit 2024-09-15T03:24:42.465221+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.179 DEBUG:teuthology.orchestra.run.smithi104:osd.5> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T03:24:43.182 INFO:tasks.cephadm:Deploying osd.6 on smithi104 with /dev/nvme2n1... 2024-09-15T03:24:43.182 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme2n1 2024-09-15T03:24:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: cluster 2024-09-15T03:24:40.303714+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:24:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: cluster 2024-09-15T03:24:40.303801+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:24:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: cluster 2024-09-15T03:24:41.832998+0000 mon.a (mon.0) 714 : cluster [INF] osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730] boot 2024-09-15T03:24:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: cluster 2024-09-15T03:24:41.833077+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-15T03:24:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:41.833278+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.429303+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:24:43.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.438154+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.438534+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.440479+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.445191+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.454153+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.456151+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.457645+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[15077]: audit 2024-09-15T03:24:42.465221+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: cluster 2024-09-15T03:24:40.303714+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: cluster 2024-09-15T03:24:40.303801+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: cluster 2024-09-15T03:24:41.832998+0000 mon.a (mon.0) 714 : cluster [INF] osd.5 [v2:172.21.15.104:6808/1629567730,v1:172.21.15.104:6809/1629567730] boot 2024-09-15T03:24:43.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: cluster 2024-09-15T03:24:41.833077+0000 mon.a (mon.0) 715 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:41.833278+0000 mon.a (mon.0) 716 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.429303+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.438154+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.438534+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.440479+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.445191+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.454153+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.456151+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.457645+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:24:43.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:42 smithi053 bash[21662]: audit 2024-09-15T03:24:42.465221+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:43.429 INFO:journalctl@ceph.osd.5.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:24:44.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: cephadm 2024-09-15T03:24:42.446653+0000 mgr.y (mgr.14150) 298 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 8120M 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: cluster 2024-09-15T03:24:42.661969+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v262: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: cluster 2024-09-15T03:24:42.842064+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: cluster 2024-09-15T03:24:43.462682+0000 mon.a (mon.0) 727 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: audit 2024-09-15T03:24:43.552007+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: audit 2024-09-15T03:24:43.559590+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: audit 2024-09-15T03:24:43.566212+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[21662]: cluster 2024-09-15T03:24:43.844898+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: cephadm 2024-09-15T03:24:42.446653+0000 mgr.y (mgr.14150) 298 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 8120M 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: cluster 2024-09-15T03:24:42.661969+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v262: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: cluster 2024-09-15T03:24:42.842064+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-15T03:24:44.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: cluster 2024-09-15T03:24:43.462682+0000 mon.a (mon.0) 727 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T03:24:44.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: audit 2024-09-15T03:24:43.552007+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: audit 2024-09-15T03:24:43.559590+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: audit 2024-09-15T03:24:43.566212+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:43 smithi053 bash[15077]: cluster 2024-09-15T03:24:43.844898+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: cephadm 2024-09-15T03:24:42.446653+0000 mgr.y (mgr.14150) 298 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 8120M 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: cluster 2024-09-15T03:24:42.661969+0000 mgr.y (mgr.14150) 299 : cluster [DBG] pgmap v262: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: cluster 2024-09-15T03:24:42.842064+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: cluster 2024-09-15T03:24:43.462682+0000 mon.a (mon.0) 727 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: audit 2024-09-15T03:24:43.552007+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: audit 2024-09-15T03:24:43.559590+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: audit 2024-09-15T03:24:43.566212+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:44.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:43 smithi104 bash[15781]: cluster 2024-09-15T03:24:43.844898+0000 mon.a (mon.0) 731 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-09-15T03:24:46.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:45 smithi053 bash[15077]: cluster 2024-09-15T03:24:44.662520+0000 mgr.y (mgr.14150) 300 : cluster [DBG] pgmap v265: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:46.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:45 smithi053 bash[15077]: cluster 2024-09-15T03:24:44.813400+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-15T03:24:46.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:45 smithi053 bash[21662]: cluster 2024-09-15T03:24:44.662520+0000 mgr.y (mgr.14150) 300 : cluster [DBG] pgmap v265: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:46.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:45 smithi053 bash[21662]: cluster 2024-09-15T03:24:44.813400+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-15T03:24:46.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:45 smithi104 bash[15781]: cluster 2024-09-15T03:24:44.662520+0000 mgr.y (mgr.14150) 300 : cluster [DBG] pgmap v265: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:46.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:45 smithi104 bash[15781]: cluster 2024-09-15T03:24:44.813400+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-09-15T03:24:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:46 smithi053 bash[15077]: cluster 2024-09-15T03:24:45.820684+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-15T03:24:47.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:46 smithi053 bash[21662]: cluster 2024-09-15T03:24:45.820684+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-15T03:24:47.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:46 smithi104 bash[15781]: cluster 2024-09-15T03:24:45.820684+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-09-15T03:24:47.973 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:24:48.081 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:47 smithi104 bash[15781]: cluster 2024-09-15T03:24:46.663093+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v268: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:48.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:47 smithi053 bash[15077]: cluster 2024-09-15T03:24:46.663093+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v268: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:48.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:47 smithi053 bash[21662]: cluster 2024-09-15T03:24:46.663093+0000 mgr.y (mgr.14150) 301 : cluster [DBG] pgmap v268: 1 pgs: 1 peering; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:24:49.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:48 smithi053 bash[21662]: cluster 2024-09-15T03:24:48.663672+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-15T03:24:49.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:48 smithi053 bash[21662]: cluster 2024-09-15T03:24:48.827192+0000 mon.a (mon.0) 734 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T03:24:49.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:48 smithi053 bash[21662]: cluster 2024-09-15T03:24:48.827242+0000 mon.a (mon.0) 735 : cluster [INF] Cluster is now healthy 2024-09-15T03:24:49.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:48 smithi053 bash[15077]: cluster 2024-09-15T03:24:48.663672+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-15T03:24:49.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:48 smithi053 bash[15077]: cluster 2024-09-15T03:24:48.827192+0000 mon.a (mon.0) 734 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T03:24:49.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:48 smithi053 bash[15077]: cluster 2024-09-15T03:24:48.827242+0000 mon.a (mon.0) 735 : cluster [INF] Cluster is now healthy 2024-09-15T03:24:49.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:48 smithi104 bash[15781]: cluster 2024-09-15T03:24:48.663672+0000 mgr.y (mgr.14150) 302 : cluster [DBG] pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-15T03:24:49.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:48 smithi104 bash[15781]: cluster 2024-09-15T03:24:48.827192+0000 mon.a (mon.0) 734 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T03:24:49.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:48 smithi104 bash[15781]: cluster 2024-09-15T03:24:48.827242+0000 mon.a (mon.0) 735 : cluster [INF] Cluster is now healthy 2024-09-15T03:24:51.982 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:51 smithi104 bash[15781]: cluster 2024-09-15T03:24:50.664219+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T03:24:52.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:51 smithi053 bash[15077]: cluster 2024-09-15T03:24:50.664219+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T03:24:52.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:51 smithi053 bash[21662]: cluster 2024-09-15T03:24:50.664219+0000 mgr.y (mgr.14150) 303 : cluster [DBG] pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-15T03:24:53.654 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/nvme2n1 2024-09-15T03:24:53.654 INFO:teuthology.orchestra.run.smithi104.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:24:53.660 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme2n1 bs=1M count=10 conv=fsync 2024-09-15T03:24:53.676 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-09-15T03:24:53.676 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-09-15T03:24:53.676 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133776 s, 784 MB/s 2024-09-15T03:24:53.677 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-09-15T03:24:53.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:53 smithi104 bash[15781]: cluster 2024-09-15T03:24:52.664797+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T03:24:54.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:53 smithi053 bash[21662]: cluster 2024-09-15T03:24:52.664797+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T03:24:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:53 smithi053 bash[15077]: cluster 2024-09-15T03:24:52.664797+0000 mgr.y (mgr.14150) 304 : cluster [DBG] pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T03:24:54.440 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi104:/dev/nvme2n1 2024-09-15T03:24:55.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:55 smithi104 bash[15781]: cluster 2024-09-15T03:24:54.665344+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:24:55.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:55 smithi104 bash[15781]: audit 2024-09-15T03:24:55.174511+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:55.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:55 smithi104 bash[15781]: audit 2024-09-15T03:24:55.180833+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:55.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:55 smithi104 bash[15781]: audit 2024-09-15T03:24:55.189277+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:56.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[21662]: cluster 2024-09-15T03:24:54.665344+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:24:56.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[21662]: audit 2024-09-15T03:24:55.174511+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:56.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[21662]: audit 2024-09-15T03:24:55.180833+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:56.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[21662]: audit 2024-09-15T03:24:55.189277+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[15077]: cluster 2024-09-15T03:24:54.665344+0000 mgr.y (mgr.14150) 305 : cluster [DBG] pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:24:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[15077]: audit 2024-09-15T03:24:55.174511+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[15077]: audit 2024-09-15T03:24:55.180833+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:55 smithi053 bash[15077]: audit 2024-09-15T03:24:55.189277+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:57.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:57 smithi104 bash[15781]: cluster 2024-09-15T03:24:56.665935+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-15T03:24:58.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:57 smithi053 bash[21662]: cluster 2024-09-15T03:24:56.665935+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-15T03:24:58.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:57 smithi053 bash[15077]: cluster 2024-09-15T03:24:56.665935+0000 mgr.y (mgr.14150) 306 : cluster [DBG] pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-15T03:24:58.954 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:24:59.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[21662]: audit 2024-09-15T03:24:58.566886+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[21662]: audit 2024-09-15T03:24:58.572494+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[21662]: audit 2024-09-15T03:24:58.580136+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[21662]: cluster 2024-09-15T03:24:58.666506+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T03:24:59.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[15077]: audit 2024-09-15T03:24:58.566886+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[15077]: audit 2024-09-15T03:24:58.572494+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[15077]: audit 2024-09-15T03:24:58.580136+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:24:59 smithi053 bash[15077]: cluster 2024-09-15T03:24:58.666506+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T03:24:59.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:59 smithi104 bash[15781]: audit 2024-09-15T03:24:58.566886+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:59 smithi104 bash[15781]: audit 2024-09-15T03:24:58.572494+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:59 smithi104 bash[15781]: audit 2024-09-15T03:24:58.580136+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:24:59.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:24:59 smithi104 bash[15781]: cluster 2024-09-15T03:24:58.666506+0000 mgr.y (mgr.14150) 307 : cluster [DBG] pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T03:25:01.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:01 smithi104 bash[15781]: cluster 2024-09-15T03:25:00.666933+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:02.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:01 smithi053 bash[15077]: cluster 2024-09-15T03:25:00.666933+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:02.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:01 smithi053 bash[21662]: cluster 2024-09-15T03:25:00.666933+0000 mgr.y (mgr.14150) 308 : cluster [DBG] pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:02.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:02 smithi104 bash[15781]: audit 2024-09-15T03:25:02.413451+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:25:02.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:02 smithi104 bash[15781]: audit 2024-09-15T03:25:02.416922+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:25:02.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:02 smithi104 bash[15781]: audit 2024-09-15T03:25:02.417888+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:03.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:02 smithi053 bash[15077]: audit 2024-09-15T03:25:02.413451+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:25:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:02 smithi053 bash[15077]: audit 2024-09-15T03:25:02.416922+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:25:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:02 smithi053 bash[15077]: audit 2024-09-15T03:25:02.417888+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:03.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:02 smithi053 bash[21662]: audit 2024-09-15T03:25:02.413451+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:25:03.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:02 smithi053 bash[21662]: audit 2024-09-15T03:25:02.416922+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:25:03.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:02 smithi053 bash[21662]: audit 2024-09-15T03:25:02.417888+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:03 smithi053 bash[15077]: audit 2024-09-15T03:25:02.408031+0000 mgr.y (mgr.14150) 309 : audit [DBG] from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:25:04.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:03 smithi053 bash[15077]: cluster 2024-09-15T03:25:02.667431+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:03 smithi053 bash[21662]: audit 2024-09-15T03:25:02.408031+0000 mgr.y (mgr.14150) 309 : audit [DBG] from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:25:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:03 smithi053 bash[21662]: cluster 2024-09-15T03:25:02.667431+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:04.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:03 smithi104 bash[15781]: audit 2024-09-15T03:25:02.408031+0000 mgr.y (mgr.14150) 309 : audit [DBG] from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:25:04.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:03 smithi104 bash[15781]: cluster 2024-09-15T03:25:02.667431+0000 mgr.y (mgr.14150) 310 : cluster [DBG] pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:05.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:04 smithi053 bash[15077]: audit 2024-09-15T03:25:03.772536+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:04 smithi053 bash[15077]: audit 2024-09-15T03:25:03.778836+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:04 smithi053 bash[15077]: audit 2024-09-15T03:25:03.785322+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:04 smithi053 bash[21662]: audit 2024-09-15T03:25:03.772536+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:04 smithi053 bash[21662]: audit 2024-09-15T03:25:03.778836+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:04 smithi053 bash[21662]: audit 2024-09-15T03:25:03.785322+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:04 smithi104 bash[15781]: audit 2024-09-15T03:25:03.772536+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:04 smithi104 bash[15781]: audit 2024-09-15T03:25:03.778836+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:05.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:04 smithi104 bash[15781]: audit 2024-09-15T03:25:03.785322+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:05 smithi053 bash[15077]: cluster 2024-09-15T03:25:04.667939+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:05 smithi053 bash[21662]: cluster 2024-09-15T03:25:04.667939+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:06.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:05 smithi104 bash[15781]: cluster 2024-09-15T03:25:04.667939+0000 mgr.y (mgr.14150) 311 : cluster [DBG] pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:07.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:07 smithi104 bash[15781]: cluster 2024-09-15T03:25:06.668501+0000 mgr.y (mgr.14150) 312 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:07 smithi053 bash[15077]: cluster 2024-09-15T03:25:06.668501+0000 mgr.y (mgr.14150) 312 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:08.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:07 smithi053 bash[21662]: cluster 2024-09-15T03:25:06.668501+0000 mgr.y (mgr.14150) 312 : cluster [DBG] pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:10.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:09 smithi053 bash[15077]: cluster 2024-09-15T03:25:08.669061+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:10.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:09 smithi053 bash[21662]: cluster 2024-09-15T03:25:08.669061+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:10.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:09 smithi104 bash[15781]: cluster 2024-09-15T03:25:08.669061+0000 mgr.y (mgr.14150) 313 : cluster [DBG] pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:12.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:11 smithi053 bash[15077]: cluster 2024-09-15T03:25:10.669610+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:11 smithi053 bash[21662]: cluster 2024-09-15T03:25:10.669610+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:12.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:11 smithi104 bash[15781]: cluster 2024-09-15T03:25:10.669610+0000 mgr.y (mgr.14150) 314 : cluster [DBG] pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:12.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:12 smithi104 bash[15781]: audit 2024-09-15T03:25:12.372932+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.104:0/2448087964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]: dispatch 2024-09-15T03:25:12.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:12 smithi104 bash[15781]: audit 2024-09-15T03:25:12.374717+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]: dispatch 2024-09-15T03:25:12.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:12 smithi104 bash[15781]: audit 2024-09-15T03:25:12.382812+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]': finished 2024-09-15T03:25:12.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:12 smithi104 bash[15781]: cluster 2024-09-15T03:25:12.382960+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e43: 7 total, 6 up, 7 in 2024-09-15T03:25:12.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:12 smithi104 bash[15781]: audit 2024-09-15T03:25:12.383171+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[15077]: audit 2024-09-15T03:25:12.372932+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.104:0/2448087964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]: dispatch 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[15077]: audit 2024-09-15T03:25:12.374717+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]: dispatch 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[15077]: audit 2024-09-15T03:25:12.382812+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]': finished 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[15077]: cluster 2024-09-15T03:25:12.382960+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e43: 7 total, 6 up, 7 in 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[15077]: audit 2024-09-15T03:25:12.383171+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[21662]: audit 2024-09-15T03:25:12.372932+0000 mon.b (mon.1) 17 : audit [INF] from='client.? 172.21.15.104:0/2448087964' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]: dispatch 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[21662]: audit 2024-09-15T03:25:12.374717+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]: dispatch 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[21662]: audit 2024-09-15T03:25:12.382812+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb"}]': finished 2024-09-15T03:25:13.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[21662]: cluster 2024-09-15T03:25:12.382960+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e43: 7 total, 6 up, 7 in 2024-09-15T03:25:13.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:12 smithi053 bash[21662]: audit 2024-09-15T03:25:12.383171+0000 mon.a (mon.0) 751 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:14.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:13 smithi053 bash[21662]: cluster 2024-09-15T03:25:12.670146+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:14.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:13 smithi053 bash[15077]: cluster 2024-09-15T03:25:12.670146+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:14.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:13 smithi104 bash[15781]: cluster 2024-09-15T03:25:12.670146+0000 mgr.y (mgr.14150) 315 : cluster [DBG] pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:15.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:14 smithi053 bash[15077]: audit 2024-09-15T03:25:13.928209+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.104:0/1264415812' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:25:15.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:14 smithi053 bash[21662]: audit 2024-09-15T03:25:13.928209+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.104:0/1264415812' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:25:15.202 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:14 smithi104 bash[15781]: audit 2024-09-15T03:25:13.928209+0000 mon.b (mon.1) 18 : audit [DBG] from='client.? 172.21.15.104:0/1264415812' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[15077]: cluster 2024-09-15T03:25:14.670699+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[15077]: audit 2024-09-15T03:25:15.185380+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[15077]: audit 2024-09-15T03:25:15.192025+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[15077]: audit 2024-09-15T03:25:15.199011+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[21662]: cluster 2024-09-15T03:25:14.670699+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[21662]: audit 2024-09-15T03:25:15.185380+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[21662]: audit 2024-09-15T03:25:15.192025+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:15 smithi053 bash[21662]: audit 2024-09-15T03:25:15.199011+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:15 smithi104 bash[15781]: cluster 2024-09-15T03:25:14.670699+0000 mgr.y (mgr.14150) 316 : cluster [DBG] pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:16.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:15 smithi104 bash[15781]: audit 2024-09-15T03:25:15.185380+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:15 smithi104 bash[15781]: audit 2024-09-15T03:25:15.192025+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:16.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:15 smithi104 bash[15781]: audit 2024-09-15T03:25:15.199011+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:18.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:17 smithi053 bash[15077]: cluster 2024-09-15T03:25:16.671269+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:18.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:17 smithi053 bash[21662]: cluster 2024-09-15T03:25:16.671269+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:18.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:17 smithi104 bash[15781]: cluster 2024-09-15T03:25:16.671269+0000 mgr.y (mgr.14150) 317 : cluster [DBG] pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:19.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:19 smithi104 bash[15781]: cluster 2024-09-15T03:25:18.671803+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:20.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:19 smithi053 bash[15077]: cluster 2024-09-15T03:25:18.671803+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:19 smithi053 bash[21662]: cluster 2024-09-15T03:25:18.671803+0000 mgr.y (mgr.14150) 318 : cluster [DBG] pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:22.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:21 smithi053 bash[15077]: cluster 2024-09-15T03:25:20.672366+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:22.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:21 smithi053 bash[21662]: cluster 2024-09-15T03:25:20.672366+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:22.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:21 smithi104 bash[15781]: cluster 2024-09-15T03:25:20.672366+0000 mgr.y (mgr.14150) 319 : cluster [DBG] pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:24.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:23 smithi053 bash[15077]: cluster 2024-09-15T03:25:22.672901+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:24.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:23 smithi053 bash[21662]: cluster 2024-09-15T03:25:22.672901+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:24.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:23 smithi104 bash[15781]: cluster 2024-09-15T03:25:22.672901+0000 mgr.y (mgr.14150) 320 : cluster [DBG] pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:25.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:24 smithi104 bash[15781]: audit 2024-09-15T03:25:23.988350+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:24 smithi104 bash[15781]: audit 2024-09-15T03:25:23.994755+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:24 smithi104 bash[15781]: audit 2024-09-15T03:25:24.002184+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:24 smithi104 bash[15781]: cluster 2024-09-15T03:25:24.673431+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:25.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[21662]: audit 2024-09-15T03:25:23.988350+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[21662]: audit 2024-09-15T03:25:23.994755+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[21662]: audit 2024-09-15T03:25:24.002184+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[21662]: cluster 2024-09-15T03:25:24.673431+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:25.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[15077]: audit 2024-09-15T03:25:23.988350+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[15077]: audit 2024-09-15T03:25:23.994755+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[15077]: audit 2024-09-15T03:25:24.002184+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:25.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:24 smithi053 bash[15077]: cluster 2024-09-15T03:25:24.673431+0000 mgr.y (mgr.14150) 321 : cluster [DBG] pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:27.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:27 smithi104 bash[15781]: cluster 2024-09-15T03:25:26.673984+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:27.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:27 smithi104 bash[15781]: audit 2024-09-15T03:25:27.409663+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T03:25:27.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:27 smithi104 bash[15781]: audit 2024-09-15T03:25:27.411726+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:28.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:27 smithi053 bash[15077]: cluster 2024-09-15T03:25:26.673984+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:28.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:27 smithi053 bash[15077]: audit 2024-09-15T03:25:27.409663+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T03:25:28.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:27 smithi053 bash[15077]: audit 2024-09-15T03:25:27.411726+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:28.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:27 smithi053 bash[21662]: cluster 2024-09-15T03:25:26.673984+0000 mgr.y (mgr.14150) 322 : cluster [DBG] pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:28.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:27 smithi053 bash[21662]: audit 2024-09-15T03:25:27.409663+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T03:25:28.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:27 smithi053 bash[21662]: audit 2024-09-15T03:25:27.411726+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:28.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:28 smithi104 bash[15781]: cephadm 2024-09-15T03:25:27.413104+0000 mgr.y (mgr.14150) 323 : cephadm [INF] Deploying daemon osd.6 on smithi104 2024-09-15T03:25:29.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:28 smithi053 bash[15077]: cephadm 2024-09-15T03:25:27.413104+0000 mgr.y (mgr.14150) 323 : cephadm [INF] Deploying daemon osd.6 on smithi104 2024-09-15T03:25:29.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:28 smithi053 bash[21662]: cephadm 2024-09-15T03:25:27.413104+0000 mgr.y (mgr.14150) 323 : cephadm [INF] Deploying daemon osd.6 on smithi104 2024-09-15T03:25:29.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:29 smithi104 bash[15781]: cluster 2024-09-15T03:25:28.674617+0000 mgr.y (mgr.14150) 324 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:30.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:29 smithi053 bash[15077]: cluster 2024-09-15T03:25:28.674617+0000 mgr.y (mgr.14150) 324 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:30.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:29 smithi053 bash[21662]: cluster 2024-09-15T03:25:28.674617+0000 mgr.y (mgr.14150) 324 : cluster [DBG] pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:32.087 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:31 smithi104 bash[15781]: cluster 2024-09-15T03:25:30.675284+0000 mgr.y (mgr.14150) 325 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:32.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:31 smithi053 bash[15077]: cluster 2024-09-15T03:25:30.675284+0000 mgr.y (mgr.14150) 325 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:32.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:31 smithi053 bash[21662]: cluster 2024-09-15T03:25:30.675284+0000 mgr.y (mgr.14150) 325 : cluster [DBG] pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:33.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[15077]: audit 2024-09-15T03:25:32.350241+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[15077]: audit 2024-09-15T03:25:32.359231+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[15077]: audit 2024-09-15T03:25:32.359749+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[15077]: audit 2024-09-15T03:25:32.361069+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[15077]: audit 2024-09-15T03:25:32.364279+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[15077]: audit 2024-09-15T03:25:32.371250+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[21662]: audit 2024-09-15T03:25:32.350241+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[21662]: audit 2024-09-15T03:25:32.359231+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[21662]: audit 2024-09-15T03:25:32.359749+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:33.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[21662]: audit 2024-09-15T03:25:32.361069+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:33.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[21662]: audit 2024-09-15T03:25:32.364279+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:32 smithi053 bash[21662]: audit 2024-09-15T03:25:32.371250+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:32 smithi104 bash[15781]: audit 2024-09-15T03:25:32.350241+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:33.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:32 smithi104 bash[15781]: audit 2024-09-15T03:25:32.359231+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:32 smithi104 bash[15781]: audit 2024-09-15T03:25:32.359749+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:33.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:32 smithi104 bash[15781]: audit 2024-09-15T03:25:32.361069+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:33.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:32 smithi104 bash[15781]: audit 2024-09-15T03:25:32.364279+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:33.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:32 smithi104 bash[15781]: audit 2024-09-15T03:25:32.371250+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:34.167 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:33 smithi104 bash[15781]: cluster 2024-09-15T03:25:32.675882+0000 mgr.y (mgr.14150) 326 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:34.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:33 smithi053 bash[15077]: cluster 2024-09-15T03:25:32.675882+0000 mgr.y (mgr.14150) 326 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:34.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:33 smithi053 bash[21662]: cluster 2024-09-15T03:25:32.675882+0000 mgr.y (mgr.14150) 326 : cluster [DBG] pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: cluster 2024-09-15T03:25:34.676498+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: audit 2024-09-15T03:25:35.362723+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: audit 2024-09-15T03:25:35.368799+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: audit 2024-09-15T03:25:35.372451+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: audit 2024-09-15T03:25:35.377347+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: audit 2024-09-15T03:25:35.378748+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: audit 2024-09-15T03:25:35.383970+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[15077]: audit 2024-09-15T03:25:35.391933+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: cluster 2024-09-15T03:25:34.676498+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: audit 2024-09-15T03:25:35.362723+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: audit 2024-09-15T03:25:35.368799+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: audit 2024-09-15T03:25:35.372451+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:36.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: audit 2024-09-15T03:25:35.377347+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: audit 2024-09-15T03:25:35.378748+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:36.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: audit 2024-09-15T03:25:35.383970+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:36.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:35 smithi053 bash[21662]: audit 2024-09-15T03:25:35.391933+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: cluster 2024-09-15T03:25:34.676498+0000 mgr.y (mgr.14150) 327 : cluster [DBG] pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:36.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: audit 2024-09-15T03:25:35.362723+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: audit 2024-09-15T03:25:35.368799+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: audit 2024-09-15T03:25:35.372451+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:36.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: audit 2024-09-15T03:25:35.377347+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: audit 2024-09-15T03:25:35.378748+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:36.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: audit 2024-09-15T03:25:35.383970+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:36.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:35 smithi104 bash[15781]: audit 2024-09-15T03:25:35.391933+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:36.929 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:36 smithi104 bash[15781]: cephadm 2024-09-15T03:25:35.370931+0000 mgr.y (mgr.14150) 328 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:25:37.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:36 smithi053 bash[15077]: cephadm 2024-09-15T03:25:35.370931+0000 mgr.y (mgr.14150) 328 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:25:37.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:36 smithi053 bash[21662]: cephadm 2024-09-15T03:25:35.370931+0000 mgr.y (mgr.14150) 328 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: cluster 2024-09-15T03:25:36.676987+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: audit 2024-09-15T03:25:37.316938+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: audit 2024-09-15T03:25:37.322743+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: audit 2024-09-15T03:25:37.325900+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: audit 2024-09-15T03:25:37.330505+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: audit 2024-09-15T03:25:37.333848+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: audit 2024-09-15T03:25:37.335014+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:38.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[15077]: audit 2024-09-15T03:25:37.342898+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: cluster 2024-09-15T03:25:36.676987+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: audit 2024-09-15T03:25:37.316938+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: audit 2024-09-15T03:25:37.322743+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: audit 2024-09-15T03:25:37.325900+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: audit 2024-09-15T03:25:37.330505+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: audit 2024-09-15T03:25:37.333848+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: audit 2024-09-15T03:25:37.335014+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:38.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:37 smithi053 bash[21662]: audit 2024-09-15T03:25:37.342898+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: cluster 2024-09-15T03:25:36.676987+0000 mgr.y (mgr.14150) 329 : cluster [DBG] pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:38.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: audit 2024-09-15T03:25:37.316938+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: audit 2024-09-15T03:25:37.322743+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: audit 2024-09-15T03:25:37.325900+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:38.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: audit 2024-09-15T03:25:37.330505+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:38.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: audit 2024-09-15T03:25:37.333848+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:38.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: audit 2024-09-15T03:25:37.335014+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:38.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:37 smithi104 bash[15781]: audit 2024-09-15T03:25:37.342898+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:39.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:39 smithi104 bash[15781]: cluster 2024-09-15T03:25:38.677642+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:40.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:39 smithi053 bash[15077]: cluster 2024-09-15T03:25:38.677642+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:40.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:39 smithi053 bash[21662]: cluster 2024-09-15T03:25:38.677642+0000 mgr.y (mgr.14150) 330 : cluster [DBG] pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:42.148 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:41 smithi104 bash[15781]: cluster 2024-09-15T03:25:40.678210+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:42.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:41 smithi053 bash[15077]: cluster 2024-09-15T03:25:40.678210+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:42.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:41 smithi053 bash[21662]: cluster 2024-09-15T03:25:40.678210+0000 mgr.y (mgr.14150) 331 : cluster [DBG] pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:42.730 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 6 on host 'smithi104' 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.336302+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.337927+0000 mon.a (mon.0) 780 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.716387+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.722343+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.722722+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.724316+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.728081+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.729452+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.734615+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.735805+0000 mon.a (mon.0) 788 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.736703+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[21662]: audit 2024-09-15T03:25:42.742611+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.336302+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.337927+0000 mon.a (mon.0) 780 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.716387+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.722343+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.722722+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.724316+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.728081+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.729452+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.734615+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.735805+0000 mon.a (mon.0) 788 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:43.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.736703+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:43.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:42 smithi053 bash[15077]: audit 2024-09-15T03:25:42.742611+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.336302+0000 mon.b (mon.1) 19 : audit [INF] from='osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.337927+0000 mon.a (mon.0) 780 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.716387+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.722343+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.722722+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.724316+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.728081+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.729452+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.734615+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.735805+0000 mon.a (mon.0) 788 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.736703+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:25:43.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:42 smithi104 bash[15781]: audit 2024-09-15T03:25:42.742611+0000 mon.a (mon.0) 790 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:43.449 DEBUG:teuthology.orchestra.run.smithi104:osd.6> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T03:25:43.452 INFO:tasks.cephadm:Deploying osd.7 on smithi104 with /dev/nvme1n1... 2024-09-15T03:25:43.452 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme1n1 2024-09-15T03:25:43.566 INFO:journalctl@ceph.osd.6.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:25:44.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[15077]: cluster 2024-09-15T03:25:42.678826+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[15077]: cephadm 2024-09-15T03:25:42.730194+0000 mgr.y (mgr.14150) 333 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 5413M 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[15077]: audit 2024-09-15T03:25:42.779259+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[15077]: audit 2024-09-15T03:25:42.779599+0000 mon.a (mon.0) 791 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[15077]: cluster 2024-09-15T03:25:42.779693+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[15077]: audit 2024-09-15T03:25:42.779845+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[15077]: audit 2024-09-15T03:25:42.780789+0000 mon.a (mon.0) 794 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[21662]: cluster 2024-09-15T03:25:42.678826+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[21662]: cephadm 2024-09-15T03:25:42.730194+0000 mgr.y (mgr.14150) 333 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 5413M 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[21662]: audit 2024-09-15T03:25:42.779259+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[21662]: audit 2024-09-15T03:25:42.779599+0000 mon.a (mon.0) 791 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T03:25:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[21662]: cluster 2024-09-15T03:25:42.779693+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-15T03:25:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[21662]: audit 2024-09-15T03:25:42.779845+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:44.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:43 smithi053 bash[21662]: audit 2024-09-15T03:25:42.780789+0000 mon.a (mon.0) 794 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:25:44.233 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[32268]: debug 2024-09-15T03:25:43.786+0000 7fcf983f0640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T03:25:44.233 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[32268]: debug 2024-09-15T03:25:43.798+0000 7fcf93a28640 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T03:25:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[15781]: cluster 2024-09-15T03:25:42.678826+0000 mgr.y (mgr.14150) 332 : cluster [DBG] pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[15781]: cephadm 2024-09-15T03:25:42.730194+0000 mgr.y (mgr.14150) 333 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 5413M 2024-09-15T03:25:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[15781]: audit 2024-09-15T03:25:42.779259+0000 mon.b (mon.1) 20 : audit [INF] from='osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:25:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[15781]: audit 2024-09-15T03:25:42.779599+0000 mon.a (mon.0) 791 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T03:25:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[15781]: cluster 2024-09-15T03:25:42.779693+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e44: 7 total, 6 up, 7 in 2024-09-15T03:25:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[15781]: audit 2024-09-15T03:25:42.779845+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:43 smithi104 bash[15781]: audit 2024-09-15T03:25:42.780789+0000 mon.a (mon.0) 794 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: audit 2024-09-15T03:25:43.784207+0000 mon.a (mon.0) 795 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: cluster 2024-09-15T03:25:43.784482+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: audit 2024-09-15T03:25:43.785097+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: audit 2024-09-15T03:25:43.791359+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: audit 2024-09-15T03:25:44.192981+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: audit 2024-09-15T03:25:44.200380+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: audit 2024-09-15T03:25:44.206456+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: cluster 2024-09-15T03:25:44.784641+0000 mon.a (mon.0) 802 : cluster [INF] osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749] boot 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: cluster 2024-09-15T03:25:44.784698+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2024-09-15T03:25:45.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[21662]: audit 2024-09-15T03:25:44.784982+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: audit 2024-09-15T03:25:43.784207+0000 mon.a (mon.0) 795 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: cluster 2024-09-15T03:25:43.784482+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: audit 2024-09-15T03:25:43.785097+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: audit 2024-09-15T03:25:43.791359+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: audit 2024-09-15T03:25:44.192981+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: audit 2024-09-15T03:25:44.200380+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: audit 2024-09-15T03:25:44.206456+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: cluster 2024-09-15T03:25:44.784641+0000 mon.a (mon.0) 802 : cluster [INF] osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749] boot 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: cluster 2024-09-15T03:25:44.784698+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2024-09-15T03:25:45.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:44 smithi053 bash[15077]: audit 2024-09-15T03:25:44.784982+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: audit 2024-09-15T03:25:43.784207+0000 mon.a (mon.0) 795 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:25:45.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: cluster 2024-09-15T03:25:43.784482+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e45: 7 total, 6 up, 7 in 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: audit 2024-09-15T03:25:43.785097+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: audit 2024-09-15T03:25:43.791359+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: audit 2024-09-15T03:25:44.192981+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: audit 2024-09-15T03:25:44.200380+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: audit 2024-09-15T03:25:44.206456+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: cluster 2024-09-15T03:25:44.784641+0000 mon.a (mon.0) 802 : cluster [INF] osd.6 [v2:172.21.15.104:6816/1526170749,v1:172.21.15.104:6817/1526170749] boot 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: cluster 2024-09-15T03:25:44.784698+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2024-09-15T03:25:45.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:44 smithi104 bash[15781]: audit 2024-09-15T03:25:44.784982+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:25:45.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[21662]: cluster 2024-09-15T03:25:43.369335+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:25:45.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[21662]: cluster 2024-09-15T03:25:43.369419+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:25:45.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[21662]: cluster 2024-09-15T03:25:44.679388+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:45.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[21662]: cluster 2024-09-15T03:25:45.788357+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-15T03:25:45.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[15077]: cluster 2024-09-15T03:25:43.369335+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:25:45.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[15077]: cluster 2024-09-15T03:25:43.369419+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:25:45.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[15077]: cluster 2024-09-15T03:25:44.679388+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:45.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:45 smithi053 bash[15077]: cluster 2024-09-15T03:25:45.788357+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-15T03:25:46.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:45 smithi104 bash[15781]: cluster 2024-09-15T03:25:43.369335+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:25:46.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:45 smithi104 bash[15781]: cluster 2024-09-15T03:25:43.369419+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:25:46.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:45 smithi104 bash[15781]: cluster 2024-09-15T03:25:44.679388+0000 mgr.y (mgr.14150) 334 : cluster [DBG] pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-15T03:25:46.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:45 smithi104 bash[15781]: cluster 2024-09-15T03:25:45.788357+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e47: 7 total, 7 up, 7 in 2024-09-15T03:25:48.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:47 smithi053 bash[21662]: cluster 2024-09-15T03:25:46.679959+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:25:48.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:47 smithi053 bash[21662]: cluster 2024-09-15T03:25:46.790181+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-15T03:25:48.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:47 smithi053 bash[15077]: cluster 2024-09-15T03:25:46.679959+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:25:48.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:47 smithi053 bash[15077]: cluster 2024-09-15T03:25:46.790181+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-15T03:25:48.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:47 smithi104 bash[15781]: cluster 2024-09-15T03:25:46.679959+0000 mgr.y (mgr.14150) 335 : cluster [DBG] pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:25:48.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:47 smithi104 bash[15781]: cluster 2024-09-15T03:25:46.790181+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e48: 7 total, 7 up, 7 in 2024-09-15T03:25:48.246 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:25:49.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:48 smithi053 bash[21662]: cluster 2024-09-15T03:25:47.799953+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-15T03:25:49.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:48 smithi053 bash[15077]: cluster 2024-09-15T03:25:47.799953+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-15T03:25:49.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:48 smithi104 bash[15781]: cluster 2024-09-15T03:25:47.799953+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e49: 7 total, 7 up, 7 in 2024-09-15T03:25:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:49 smithi053 bash[15077]: cluster 2024-09-15T03:25:48.680697+0000 mgr.y (mgr.14150) 336 : cluster [DBG] pgmap v306: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-09-15T03:25:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:49 smithi053 bash[15077]: cluster 2024-09-15T03:25:48.796110+0000 mon.a (mon.0) 808 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-15T03:25:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:49 smithi053 bash[15077]: cluster 2024-09-15T03:25:48.808913+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-15T03:25:50.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:49 smithi053 bash[21662]: cluster 2024-09-15T03:25:48.680697+0000 mgr.y (mgr.14150) 336 : cluster [DBG] pgmap v306: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-09-15T03:25:50.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:49 smithi053 bash[21662]: cluster 2024-09-15T03:25:48.796110+0000 mon.a (mon.0) 808 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-15T03:25:50.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:49 smithi053 bash[21662]: cluster 2024-09-15T03:25:48.808913+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-15T03:25:50.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:49 smithi104 bash[15781]: cluster 2024-09-15T03:25:48.680697+0000 mgr.y (mgr.14150) 336 : cluster [DBG] pgmap v306: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 2/6 objects degraded (33.333%) 2024-09-15T03:25:50.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:49 smithi104 bash[15781]: cluster 2024-09-15T03:25:48.796110+0000 mon.a (mon.0) 808 : cluster [WRN] Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-15T03:25:50.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:49 smithi104 bash[15781]: cluster 2024-09-15T03:25:48.808913+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e50: 7 total, 7 up, 7 in 2024-09-15T03:25:51.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:50 smithi053 bash[21662]: cluster 2024-09-15T03:25:50.681341+0000 mgr.y (mgr.14150) 337 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T03:25:51.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:50 smithi053 bash[21662]: cluster 2024-09-15T03:25:50.824521+0000 mon.a (mon.0) 810 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-15T03:25:51.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:50 smithi053 bash[21662]: cluster 2024-09-15T03:25:50.824570+0000 mon.a (mon.0) 811 : cluster [INF] Cluster is now healthy 2024-09-15T03:25:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:50 smithi053 bash[15077]: cluster 2024-09-15T03:25:50.681341+0000 mgr.y (mgr.14150) 337 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T03:25:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:50 smithi053 bash[15077]: cluster 2024-09-15T03:25:50.824521+0000 mon.a (mon.0) 810 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-15T03:25:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:50 smithi053 bash[15077]: cluster 2024-09-15T03:25:50.824570+0000 mon.a (mon.0) 811 : cluster [INF] Cluster is now healthy 2024-09-15T03:25:51.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:50 smithi104 bash[15781]: cluster 2024-09-15T03:25:50.681341+0000 mgr.y (mgr.14150) 337 : cluster [DBG] pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T03:25:51.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:50 smithi104 bash[15781]: cluster 2024-09-15T03:25:50.824521+0000 mon.a (mon.0) 810 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-15T03:25:51.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:50 smithi104 bash[15781]: cluster 2024-09-15T03:25:50.824570+0000 mon.a (mon.0) 811 : cluster [INF] Cluster is now healthy 2024-09-15T03:25:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping: /dev/nvme1n1 2024-09-15T03:25:52.251 INFO:teuthology.orchestra.run.smithi104.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-15T03:25:52.257 INFO:teuthology.orchestra.run.smithi104.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=10 conv=fsync 2024-09-15T03:25:52.274 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10+0 records in 2024-09-15T03:25:52.274 INFO:teuthology.orchestra.run.smithi104.stderr:10+0 records out 2024-09-15T03:25:52.274 INFO:teuthology.orchestra.run.smithi104.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0147597 s, 710 MB/s 2024-09-15T03:25:52.275 INFO:teuthology.orchestra.run.smithi104.stderr:--> Zapping successful for: 2024-09-15T03:25:53.262 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi104:/dev/nvme1n1 2024-09-15T03:25:53.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:53 smithi104 bash[15781]: cluster 2024-09-15T03:25:52.682038+0000 mgr.y (mgr.14150) 338 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T03:25:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:53 smithi053 bash[15077]: cluster 2024-09-15T03:25:52.682038+0000 mgr.y (mgr.14150) 338 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T03:25:54.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:53 smithi053 bash[21662]: cluster 2024-09-15T03:25:52.682038+0000 mgr.y (mgr.14150) 338 : cluster [DBG] pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T03:25:56.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:55 smithi053 bash[21662]: cluster 2024-09-15T03:25:54.682768+0000 mgr.y (mgr.14150) 339 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T03:25:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:55 smithi053 bash[15077]: cluster 2024-09-15T03:25:54.682768+0000 mgr.y (mgr.14150) 339 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T03:25:56.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:55 smithi104 bash[15781]: cluster 2024-09-15T03:25:54.682768+0000 mgr.y (mgr.14150) 339 : cluster [DBG] pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T03:25:57.769 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:25:57.777 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:57 smithi104 bash[15781]: cluster 2024-09-15T03:25:56.683499+0000 mgr.y (mgr.14150) 340 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T03:25:57.777 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:57 smithi104 bash[15781]: audit 2024-09-15T03:25:57.509628+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:57.777 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:57 smithi104 bash[15781]: audit 2024-09-15T03:25:57.515398+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:57.777 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:57 smithi104 bash[15781]: audit 2024-09-15T03:25:57.522518+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:58.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[15077]: cluster 2024-09-15T03:25:56.683499+0000 mgr.y (mgr.14150) 340 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T03:25:58.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[15077]: audit 2024-09-15T03:25:57.509628+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:58.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[15077]: audit 2024-09-15T03:25:57.515398+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:58.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[15077]: audit 2024-09-15T03:25:57.522518+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:58.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[21662]: cluster 2024-09-15T03:25:56.683499+0000 mgr.y (mgr.14150) 340 : cluster [DBG] pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-15T03:25:58.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[21662]: audit 2024-09-15T03:25:57.509628+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:58.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[21662]: audit 2024-09-15T03:25:57.515398+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:58.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:57 smithi053 bash[21662]: audit 2024-09-15T03:25:57.522518+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[15077]: audit 2024-09-15T03:25:58.289781+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[15077]: audit 2024-09-15T03:25:58.295915+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[15077]: audit 2024-09-15T03:25:58.302625+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[15077]: cluster 2024-09-15T03:25:58.684103+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:25:59.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[21662]: audit 2024-09-15T03:25:58.289781+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[21662]: audit 2024-09-15T03:25:58.295915+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[21662]: audit 2024-09-15T03:25:58.302625+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:25:59 smithi053 bash[21662]: cluster 2024-09-15T03:25:58.684103+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:25:59.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:59 smithi104 bash[15781]: audit 2024-09-15T03:25:58.289781+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:59 smithi104 bash[15781]: audit 2024-09-15T03:25:58.295915+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:59 smithi104 bash[15781]: audit 2024-09-15T03:25:58.302625+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:25:59.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:25:59 smithi104 bash[15781]: cluster 2024-09-15T03:25:58.684103+0000 mgr.y (mgr.14150) 341 : cluster [DBG] pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:26:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[15077]: cluster 2024-09-15T03:26:00.684707+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T03:26:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[15077]: audit 2024-09-15T03:26:01.371080+0000 mon.a (mon.0) 818 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:26:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[15077]: audit 2024-09-15T03:26:01.377203+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:26:02.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[15077]: audit 2024-09-15T03:26:01.378455+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[21662]: cluster 2024-09-15T03:26:00.684707+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T03:26:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[21662]: audit 2024-09-15T03:26:01.371080+0000 mon.a (mon.0) 818 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:26:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[21662]: audit 2024-09-15T03:26:01.377203+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:26:02.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:01 smithi053 bash[21662]: audit 2024-09-15T03:26:01.378455+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:02.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:01 smithi104 bash[15781]: cluster 2024-09-15T03:26:00.684707+0000 mgr.y (mgr.14150) 342 : cluster [DBG] pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-15T03:26:02.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:01 smithi104 bash[15781]: audit 2024-09-15T03:26:01.371080+0000 mon.a (mon.0) 818 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T03:26:02.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:01 smithi104 bash[15781]: audit 2024-09-15T03:26:01.377203+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T03:26:02.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:01 smithi104 bash[15781]: audit 2024-09-15T03:26:01.378455+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:03.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:02 smithi053 bash[15077]: audit 2024-09-15T03:26:01.365205+0000 mgr.y (mgr.14150) 343 : audit [DBG] from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:26:03.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:02 smithi053 bash[21662]: audit 2024-09-15T03:26:01.365205+0000 mgr.y (mgr.14150) 343 : audit [DBG] from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:26:03.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:02 smithi104 bash[15781]: audit 2024-09-15T03:26:01.365205+0000 mgr.y (mgr.14150) 343 : audit [DBG] from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi104:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:26:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:03 smithi053 bash[21662]: cluster 2024-09-15T03:26:02.685281+0000 mgr.y (mgr.14150) 344 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:04.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:03 smithi053 bash[15077]: cluster 2024-09-15T03:26:02.685281+0000 mgr.y (mgr.14150) 344 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:04.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:03 smithi104 bash[15781]: cluster 2024-09-15T03:26:02.685281+0000 mgr.y (mgr.14150) 344 : cluster [DBG] pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:05.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[21662]: audit 2024-09-15T03:26:04.404707+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[21662]: audit 2024-09-15T03:26:04.410422+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[21662]: audit 2024-09-15T03:26:04.416086+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[21662]: cluster 2024-09-15T03:26:04.685856+0000 mgr.y (mgr.14150) 345 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:05.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[15077]: audit 2024-09-15T03:26:04.404707+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[15077]: audit 2024-09-15T03:26:04.410422+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[15077]: audit 2024-09-15T03:26:04.416086+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:05 smithi053 bash[15077]: cluster 2024-09-15T03:26:04.685856+0000 mgr.y (mgr.14150) 345 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:05.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:05 smithi104 bash[15781]: audit 2024-09-15T03:26:04.404707+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:05 smithi104 bash[15781]: audit 2024-09-15T03:26:04.410422+0000 mon.a (mon.0) 822 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:05 smithi104 bash[15781]: audit 2024-09-15T03:26:04.416086+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:05.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:05 smithi104 bash[15781]: cluster 2024-09-15T03:26:04.685856+0000 mgr.y (mgr.14150) 345 : cluster [DBG] pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:07.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:07 smithi104 bash[15781]: cluster 2024-09-15T03:26:06.686406+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:08.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:07 smithi053 bash[15077]: cluster 2024-09-15T03:26:06.686406+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:08.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:07 smithi053 bash[21662]: cluster 2024-09-15T03:26:06.686406+0000 mgr.y (mgr.14150) 346 : cluster [DBG] pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:10.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:09 smithi053 bash[15077]: cluster 2024-09-15T03:26:08.686959+0000 mgr.y (mgr.14150) 347 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:10.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:09 smithi053 bash[21662]: cluster 2024-09-15T03:26:08.686959+0000 mgr.y (mgr.14150) 347 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:10.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:09 smithi104 bash[15781]: cluster 2024-09-15T03:26:08.686959+0000 mgr.y (mgr.14150) 347 : cluster [DBG] pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:10.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:10 smithi104 bash[15781]: audit 2024-09-15T03:26:10.202532+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.104:0/2063984951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]: dispatch 2024-09-15T03:26:10.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:10 smithi104 bash[15781]: audit 2024-09-15T03:26:10.204665+0000 mon.a (mon.0) 824 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]: dispatch 2024-09-15T03:26:10.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:10 smithi104 bash[15781]: audit 2024-09-15T03:26:10.212670+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]': finished 2024-09-15T03:26:10.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:10 smithi104 bash[15781]: cluster 2024-09-15T03:26:10.212757+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e51: 8 total, 7 up, 8 in 2024-09-15T03:26:10.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:10 smithi104 bash[15781]: audit 2024-09-15T03:26:10.212972+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:11.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[15077]: audit 2024-09-15T03:26:10.202532+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.104:0/2063984951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]: dispatch 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[15077]: audit 2024-09-15T03:26:10.204665+0000 mon.a (mon.0) 824 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]: dispatch 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[15077]: audit 2024-09-15T03:26:10.212670+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]': finished 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[15077]: cluster 2024-09-15T03:26:10.212757+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e51: 8 total, 7 up, 8 in 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[15077]: audit 2024-09-15T03:26:10.212972+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[21662]: audit 2024-09-15T03:26:10.202532+0000 mon.b (mon.1) 21 : audit [INF] from='client.? 172.21.15.104:0/2063984951' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]: dispatch 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[21662]: audit 2024-09-15T03:26:10.204665+0000 mon.a (mon.0) 824 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]: dispatch 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[21662]: audit 2024-09-15T03:26:10.212670+0000 mon.a (mon.0) 825 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31d4fbee-353b-4551-8c13-9e3d7bc06df0"}]': finished 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[21662]: cluster 2024-09-15T03:26:10.212757+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e51: 8 total, 7 up, 8 in 2024-09-15T03:26:11.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:10 smithi053 bash[21662]: audit 2024-09-15T03:26:10.212972+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:12.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:11 smithi053 bash[15077]: cluster 2024-09-15T03:26:10.687499+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:11 smithi053 bash[21662]: cluster 2024-09-15T03:26:10.687499+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:12.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:11 smithi104 bash[15781]: cluster 2024-09-15T03:26:10.687499+0000 mgr.y (mgr.14150) 348 : cluster [DBG] pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:13.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:12 smithi053 bash[15077]: audit 2024-09-15T03:26:12.150162+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.104:0/3480403323' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:26:13.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:12 smithi053 bash[21662]: audit 2024-09-15T03:26:12.150162+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.104:0/3480403323' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:26:13.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:12 smithi104 bash[15781]: audit 2024-09-15T03:26:12.150162+0000 mon.b (mon.1) 22 : audit [DBG] from='client.? 172.21.15.104:0/3480403323' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T03:26:14.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:13 smithi053 bash[15077]: cluster 2024-09-15T03:26:12.688111+0000 mgr.y (mgr.14150) 349 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:14.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:13 smithi053 bash[21662]: cluster 2024-09-15T03:26:12.688111+0000 mgr.y (mgr.14150) 349 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:14.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:13 smithi104 bash[15781]: cluster 2024-09-15T03:26:12.688111+0000 mgr.y (mgr.14150) 349 : cluster [DBG] pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:15.900 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:15 smithi104 bash[15781]: cluster 2024-09-15T03:26:14.688682+0000 mgr.y (mgr.14150) 350 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:16.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:15 smithi053 bash[15077]: cluster 2024-09-15T03:26:14.688682+0000 mgr.y (mgr.14150) 350 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:16.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:15 smithi053 bash[21662]: cluster 2024-09-15T03:26:14.688682+0000 mgr.y (mgr.14150) 350 : cluster [DBG] pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[15077]: audit 2024-09-15T03:26:16.171847+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[15077]: audit 2024-09-15T03:26:16.178707+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[15077]: audit 2024-09-15T03:26:16.186306+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[15077]: cluster 2024-09-15T03:26:16.689362+0000 mgr.y (mgr.14150) 351 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[21662]: audit 2024-09-15T03:26:16.171847+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[21662]: audit 2024-09-15T03:26:16.178707+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[21662]: audit 2024-09-15T03:26:16.186306+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:17 smithi053 bash[21662]: cluster 2024-09-15T03:26:16.689362+0000 mgr.y (mgr.14150) 351 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:17.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:17 smithi104 bash[15781]: audit 2024-09-15T03:26:16.171847+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:17 smithi104 bash[15781]: audit 2024-09-15T03:26:16.178707+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:17 smithi104 bash[15781]: audit 2024-09-15T03:26:16.186306+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:17.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:17 smithi104 bash[15781]: cluster 2024-09-15T03:26:16.689362+0000 mgr.y (mgr.14150) 351 : cluster [DBG] pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:20.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:19 smithi053 bash[15077]: cluster 2024-09-15T03:26:18.689999+0000 mgr.y (mgr.14150) 352 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:19 smithi053 bash[21662]: cluster 2024-09-15T03:26:18.689999+0000 mgr.y (mgr.14150) 352 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:20.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:19 smithi104 bash[15781]: cluster 2024-09-15T03:26:18.689999+0000 mgr.y (mgr.14150) 352 : cluster [DBG] pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:22.139 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:21 smithi104 bash[15781]: cluster 2024-09-15T03:26:20.690582+0000 mgr.y (mgr.14150) 353 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:22.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:21 smithi053 bash[15077]: cluster 2024-09-15T03:26:20.690582+0000 mgr.y (mgr.14150) 353 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:22.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:21 smithi053 bash[21662]: cluster 2024-09-15T03:26:20.690582+0000 mgr.y (mgr.14150) 353 : cluster [DBG] pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:24.041 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:23 smithi104 bash[15781]: cluster 2024-09-15T03:26:22.691181+0000 mgr.y (mgr.14150) 354 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:24.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:23 smithi053 bash[15077]: cluster 2024-09-15T03:26:22.691181+0000 mgr.y (mgr.14150) 354 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:24.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:23 smithi053 bash[21662]: cluster 2024-09-15T03:26:22.691181+0000 mgr.y (mgr.14150) 354 : cluster [DBG] pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:25.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[15077]: audit 2024-09-15T03:26:24.593793+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[15077]: audit 2024-09-15T03:26:24.600018+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[15077]: audit 2024-09-15T03:26:24.606405+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[15077]: cluster 2024-09-15T03:26:24.691783+0000 mgr.y (mgr.14150) 355 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:25.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[15077]: audit 2024-09-15T03:26:25.065611+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T03:26:25.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[15077]: audit 2024-09-15T03:26:25.067355+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:25.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[21662]: audit 2024-09-15T03:26:24.593793+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[21662]: audit 2024-09-15T03:26:24.600018+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[21662]: audit 2024-09-15T03:26:24.606405+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[21662]: cluster 2024-09-15T03:26:24.691783+0000 mgr.y (mgr.14150) 355 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:25.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[21662]: audit 2024-09-15T03:26:25.065611+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T03:26:25.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:25 smithi053 bash[21662]: audit 2024-09-15T03:26:25.067355+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:25.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:25 smithi104 bash[15781]: audit 2024-09-15T03:26:24.593793+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:25 smithi104 bash[15781]: audit 2024-09-15T03:26:24.600018+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:25 smithi104 bash[15781]: audit 2024-09-15T03:26:24.606405+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:25.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:25 smithi104 bash[15781]: cluster 2024-09-15T03:26:24.691783+0000 mgr.y (mgr.14150) 355 : cluster [DBG] pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:25.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:25 smithi104 bash[15781]: audit 2024-09-15T03:26:25.065611+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T03:26:25.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:25 smithi104 bash[15781]: audit 2024-09-15T03:26:25.067355+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:26.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:26 smithi053 bash[15077]: cephadm 2024-09-15T03:26:25.068868+0000 mgr.y (mgr.14150) 356 : cephadm [INF] Deploying daemon osd.7 on smithi104 2024-09-15T03:26:26.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:26 smithi053 bash[21662]: cephadm 2024-09-15T03:26:25.068868+0000 mgr.y (mgr.14150) 356 : cephadm [INF] Deploying daemon osd.7 on smithi104 2024-09-15T03:26:26.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:26 smithi104 bash[15781]: cephadm 2024-09-15T03:26:25.068868+0000 mgr.y (mgr.14150) 356 : cephadm [INF] Deploying daemon osd.7 on smithi104 2024-09-15T03:26:27.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:27 smithi104 bash[15781]: cluster 2024-09-15T03:26:26.692392+0000 mgr.y (mgr.14150) 357 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:27.923 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:27 smithi053 bash[21662]: cluster 2024-09-15T03:26:26.692392+0000 mgr.y (mgr.14150) 357 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:27.924 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:27 smithi053 bash[15077]: cluster 2024-09-15T03:26:26.692392+0000 mgr.y (mgr.14150) 357 : cluster [DBG] pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:29.942 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:29 smithi104 bash[15781]: cluster 2024-09-15T03:26:28.692984+0000 mgr.y (mgr.14150) 358 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:30.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:29 smithi053 bash[15077]: cluster 2024-09-15T03:26:28.692984+0000 mgr.y (mgr.14150) 358 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:30.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:29 smithi053 bash[21662]: cluster 2024-09-15T03:26:28.692984+0000 mgr.y (mgr.14150) 358 : cluster [DBG] pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:31.039 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:30 smithi104 bash[15781]: audit 2024-09-15T03:26:29.974091+0000 mon.a (mon.0) 836 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:31.039 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:30 smithi104 bash[15781]: audit 2024-09-15T03:26:29.982256+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.039 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:30 smithi104 bash[15781]: audit 2024-09-15T03:26:29.982598+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:31.040 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:30 smithi104 bash[15781]: audit 2024-09-15T03:26:29.984518+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:31.040 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:30 smithi104 bash[15781]: audit 2024-09-15T03:26:29.987909+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.040 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:30 smithi104 bash[15781]: audit 2024-09-15T03:26:29.992753+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[15077]: audit 2024-09-15T03:26:29.974091+0000 mon.a (mon.0) 836 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[15077]: audit 2024-09-15T03:26:29.982256+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[15077]: audit 2024-09-15T03:26:29.982598+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[15077]: audit 2024-09-15T03:26:29.984518+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[15077]: audit 2024-09-15T03:26:29.987909+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[15077]: audit 2024-09-15T03:26:29.992753+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[21662]: audit 2024-09-15T03:26:29.974091+0000 mon.a (mon.0) 836 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[21662]: audit 2024-09-15T03:26:29.982256+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[21662]: audit 2024-09-15T03:26:29.982598+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:31.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[21662]: audit 2024-09-15T03:26:29.984518+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:31.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[21662]: audit 2024-09-15T03:26:29.987909+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:30 smithi053 bash[21662]: audit 2024-09-15T03:26:29.992753+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:31.999 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:31 smithi104 bash[15781]: cluster 2024-09-15T03:26:30.693657+0000 mgr.y (mgr.14150) 359 : cluster [DBG] pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:32.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:31 smithi053 bash[15077]: cluster 2024-09-15T03:26:30.693657+0000 mgr.y (mgr.14150) 359 : cluster [DBG] pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:32.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:31 smithi053 bash[21662]: cluster 2024-09-15T03:26:30.693657+0000 mgr.y (mgr.14150) 359 : cluster [DBG] pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:33.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:33 smithi104 bash[15781]: cluster 2024-09-15T03:26:32.694218+0000 mgr.y (mgr.14150) 360 : cluster [DBG] pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:34.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:33 smithi053 bash[15077]: cluster 2024-09-15T03:26:32.694218+0000 mgr.y (mgr.14150) 360 : cluster [DBG] pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:34.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:33 smithi053 bash[21662]: cluster 2024-09-15T03:26:32.694218+0000 mgr.y (mgr.14150) 360 : cluster [DBG] pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:35.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:35 smithi104 bash[15781]: cluster 2024-09-15T03:26:34.694746+0000 mgr.y (mgr.14150) 361 : cluster [DBG] pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:36.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:35 smithi053 bash[15077]: cluster 2024-09-15T03:26:34.694746+0000 mgr.y (mgr.14150) 361 : cluster [DBG] pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:35 smithi053 bash[21662]: cluster 2024-09-15T03:26:34.694746+0000 mgr.y (mgr.14150) 361 : cluster [DBG] pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:37.480 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: audit 2024-09-15T03:26:36.374499+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: audit 2024-09-15T03:26:36.381167+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: cephadm 2024-09-15T03:26:36.383546+0000 mgr.y (mgr.14150) 362 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: audit 2024-09-15T03:26:36.385177+0000 mon.a (mon.0) 844 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: audit 2024-09-15T03:26:36.390923+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: audit 2024-09-15T03:26:36.391202+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: audit 2024-09-15T03:26:36.392693+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: audit 2024-09-15T03:26:36.399982+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.481 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:37 smithi104 bash[15781]: cluster 2024-09-15T03:26:36.695330+0000 mgr.y (mgr.14150) 363 : cluster [DBG] pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: audit 2024-09-15T03:26:36.374499+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: audit 2024-09-15T03:26:36.381167+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: cephadm 2024-09-15T03:26:36.383546+0000 mgr.y (mgr.14150) 362 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: audit 2024-09-15T03:26:36.385177+0000 mon.a (mon.0) 844 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: audit 2024-09-15T03:26:36.390923+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: audit 2024-09-15T03:26:36.391202+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: audit 2024-09-15T03:26:36.392693+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: audit 2024-09-15T03:26:36.399982+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[21662]: cluster 2024-09-15T03:26:36.695330+0000 mgr.y (mgr.14150) 363 : cluster [DBG] pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: audit 2024-09-15T03:26:36.374499+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: audit 2024-09-15T03:26:36.381167+0000 mon.a (mon.0) 843 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: cephadm 2024-09-15T03:26:36.383546+0000 mgr.y (mgr.14150) 362 : cephadm [INF] Detected new or changed devices on smithi104 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: audit 2024-09-15T03:26:36.385177+0000 mon.a (mon.0) 844 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: audit 2024-09-15T03:26:36.390923+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: audit 2024-09-15T03:26:36.391202+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: audit 2024-09-15T03:26:36.392693+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: audit 2024-09-15T03:26:36.399982+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:37.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:37 smithi053 bash[15077]: cluster 2024-09-15T03:26:36.695330+0000 mgr.y (mgr.14150) 363 : cluster [DBG] pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.059064+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.065870+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.069441+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.073022+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.076291+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.077587+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.085089+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.642587+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: audit 2024-09-15T03:26:38.644742+0000 mon.a (mon.0) 856 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[15077]: cluster 2024-09-15T03:26:38.695885+0000 mgr.y (mgr.14150) 364 : cluster [DBG] pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.059064+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.065870+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.069441+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.073022+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.076291+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.077587+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.085089+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.642587+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: audit 2024-09-15T03:26:38.644742+0000 mon.a (mon.0) 856 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T03:26:39.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:39 smithi053 bash[21662]: cluster 2024-09-15T03:26:38.695885+0000 mgr.y (mgr.14150) 364 : cluster [DBG] pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.059064+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.065870+0000 mon.a (mon.0) 850 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.069441+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.073022+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.076291+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.077587+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.085089+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.642587+0000 mon.b (mon.1) 23 : audit [INF] from='osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T03:26:39.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: audit 2024-09-15T03:26:38.644742+0000 mon.a (mon.0) 856 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T03:26:39.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:39 smithi104 bash[15781]: cluster 2024-09-15T03:26:38.695885+0000 mgr.y (mgr.14150) 364 : cluster [DBG] pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[15077]: audit 2024-09-15T03:26:39.092044+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:26:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[15077]: audit 2024-09-15T03:26:39.092156+0000 mon.a (mon.0) 857 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T03:26:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[15077]: cluster 2024-09-15T03:26:39.092255+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-15T03:26:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[15077]: audit 2024-09-15T03:26:39.092487+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[15077]: audit 2024-09-15T03:26:39.094044+0000 mon.a (mon.0) 860 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:26:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[21662]: audit 2024-09-15T03:26:39.092044+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:26:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[21662]: audit 2024-09-15T03:26:39.092156+0000 mon.a (mon.0) 857 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T03:26:40.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[21662]: cluster 2024-09-15T03:26:39.092255+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-15T03:26:40.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[21662]: audit 2024-09-15T03:26:39.092487+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:40.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:40 smithi053 bash[21662]: audit 2024-09-15T03:26:39.094044+0000 mon.a (mon.0) 860 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:26:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:40 smithi104 bash[15781]: audit 2024-09-15T03:26:39.092044+0000 mon.b (mon.1) 24 : audit [INF] from='osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:26:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:40 smithi104 bash[15781]: audit 2024-09-15T03:26:39.092156+0000 mon.a (mon.0) 857 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T03:26:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:40 smithi104 bash[15781]: cluster 2024-09-15T03:26:39.092255+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e52: 8 total, 7 up, 8 in 2024-09-15T03:26:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:40 smithi104 bash[15781]: audit 2024-09-15T03:26:39.092487+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:40 smithi104 bash[15781]: audit 2024-09-15T03:26:39.094044+0000 mon.a (mon.0) 860 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]: dispatch 2024-09-15T03:26:41.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:41 smithi104 bash[15781]: audit 2024-09-15T03:26:40.096177+0000 mon.a (mon.0) 861 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:26:41.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:41 smithi104 bash[15781]: cluster 2024-09-15T03:26:40.096373+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-15T03:26:41.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:41 smithi104 bash[15781]: audit 2024-09-15T03:26:40.097038+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:41.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:41 smithi104 bash[15781]: audit 2024-09-15T03:26:40.104500+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:41.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:41 smithi104 bash[15781]: cluster 2024-09-15T03:26:40.696437+0000 mgr.y (mgr.14150) 365 : cluster [DBG] pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:41.393 INFO:teuthology.orchestra.run.smithi104.stdout:Created osd(s) 7 on host 'smithi104' 2024-09-15T03:26:41.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[15077]: audit 2024-09-15T03:26:40.096177+0000 mon.a (mon.0) 861 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[15077]: cluster 2024-09-15T03:26:40.096373+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[15077]: audit 2024-09-15T03:26:40.097038+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[15077]: audit 2024-09-15T03:26:40.104500+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[15077]: cluster 2024-09-15T03:26:40.696437+0000 mgr.y (mgr.14150) 365 : cluster [DBG] pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[21662]: audit 2024-09-15T03:26:40.096177+0000 mon.a (mon.0) 861 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi104", "root=default"]}]': finished 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[21662]: cluster 2024-09-15T03:26:40.096373+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e53: 8 total, 7 up, 8 in 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[21662]: audit 2024-09-15T03:26:40.097038+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[21662]: audit 2024-09-15T03:26:40.104500+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:41.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:41 smithi053 bash[21662]: cluster 2024-09-15T03:26:40.696437+0000 mgr.y (mgr.14150) 365 : cluster [DBG] pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 2.0 GiB used, 624 GiB / 626 GiB avail 2024-09-15T03:26:42.063 DEBUG:teuthology.orchestra.run.smithi104:osd.7> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T03:26:42.065 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-09-15T03:26:42.066 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T03:26:42.287 INFO:journalctl@ceph.osd.7.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:26:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: cluster 2024-09-15T03:26:39.651082+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:26:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: cluster 2024-09-15T03:26:39.651181+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:26:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: cluster 2024-09-15T03:26:41.106213+0000 mon.a (mon.0) 865 : cluster [INF] osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612] boot 2024-09-15T03:26:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: cluster 2024-09-15T03:26:41.106293+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.106894+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.377761+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.383927+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.384293+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.386640+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.390358+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.391833+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.392969+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: cephadm 2024-09-15T03:26:41.393878+0000 mgr.y (mgr.14150) 366 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 4060M 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.399408+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.401311+0000 mon.a (mon.0) 876 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.402634+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[15077]: audit 2024-09-15T03:26:41.409579+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: cluster 2024-09-15T03:26:39.651082+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: cluster 2024-09-15T03:26:39.651181+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: cluster 2024-09-15T03:26:41.106213+0000 mon.a (mon.0) 865 : cluster [INF] osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612] boot 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: cluster 2024-09-15T03:26:41.106293+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-15T03:26:42.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.106894+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.377761+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.383927+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.384293+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.386640+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.390358+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.391833+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.392969+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: cephadm 2024-09-15T03:26:41.393878+0000 mgr.y (mgr.14150) 366 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 4060M 2024-09-15T03:26:42.444 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.399408+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.445 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.401311+0000 mon.a (mon.0) 876 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:42.445 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.402634+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:42.445 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:42 smithi053 bash[21662]: audit 2024-09-15T03:26:41.409579+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: cluster 2024-09-15T03:26:39.651082+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: cluster 2024-09-15T03:26:39.651181+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: cluster 2024-09-15T03:26:41.106213+0000 mon.a (mon.0) 865 : cluster [INF] osd.7 [v2:172.21.15.104:6824/760848612,v1:172.21.15.104:6825/760848612] boot 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: cluster 2024-09-15T03:26:41.106293+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.106894+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.377761+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.383927+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.384293+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.386640+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.390358+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.391833+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.392969+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: cephadm 2024-09-15T03:26:41.393878+0000 mgr.y (mgr.14150) 366 : cephadm [INF] Adjusting osd_memory_target on smithi104 to 4060M 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.399408+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.401311+0000 mon.a (mon.0) 876 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.402634+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:26:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:42 smithi104 bash[15781]: audit 2024-09-15T03:26:41.409579+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:43.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:43 smithi053 bash[15077]: cluster 2024-09-15T03:26:42.122605+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-15T03:26:43.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:43 smithi053 bash[15077]: cluster 2024-09-15T03:26:42.697018+0000 mgr.y (mgr.14150) 367 : cluster [DBG] pgmap v339: 1 pgs: 1 remapped+peering; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:26:43.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:43 smithi053 bash[21662]: cluster 2024-09-15T03:26:42.122605+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-15T03:26:43.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:43 smithi053 bash[21662]: cluster 2024-09-15T03:26:42.697018+0000 mgr.y (mgr.14150) 367 : cluster [DBG] pgmap v339: 1 pgs: 1 remapped+peering; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:26:43.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:43 smithi104 bash[15781]: cluster 2024-09-15T03:26:42.122605+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-09-15T03:26:43.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:43 smithi104 bash[15781]: cluster 2024-09-15T03:26:42.697018+0000 mgr.y (mgr.14150) 367 : cluster [DBG] pgmap v339: 1 pgs: 1 remapped+peering; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:26:44.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:44 smithi053 bash[21662]: cluster 2024-09-15T03:26:43.127233+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-15T03:26:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:44 smithi053 bash[15077]: cluster 2024-09-15T03:26:43.127233+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-15T03:26:44.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:44 smithi104 bash[15781]: cluster 2024-09-15T03:26:43.127233+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[15077]: cluster 2024-09-15T03:26:44.144023+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[15077]: cluster 2024-09-15T03:26:44.697551+0000 mgr.y (mgr.14150) 368 : cluster [DBG] pgmap v342: 1 pgs: 1 remapped+peering; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[15077]: audit 2024-09-15T03:26:44.783439+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[15077]: audit 2024-09-15T03:26:44.789300+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[15077]: audit 2024-09-15T03:26:44.795422+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[21662]: cluster 2024-09-15T03:26:44.144023+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[21662]: cluster 2024-09-15T03:26:44.697551+0000 mgr.y (mgr.14150) 368 : cluster [DBG] pgmap v342: 1 pgs: 1 remapped+peering; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:26:45.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[21662]: audit 2024-09-15T03:26:44.783439+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[21662]: audit 2024-09-15T03:26:44.789300+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:45 smithi053 bash[21662]: audit 2024-09-15T03:26:44.795422+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:45 smithi104 bash[15781]: cluster 2024-09-15T03:26:44.144023+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-09-15T03:26:45.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:45 smithi104 bash[15781]: cluster 2024-09-15T03:26:44.697551+0000 mgr.y (mgr.14150) 368 : cluster [DBG] pgmap v342: 1 pgs: 1 remapped+peering; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:26:45.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:45 smithi104 bash[15781]: audit 2024-09-15T03:26:44.783439+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:45 smithi104 bash[15781]: audit 2024-09-15T03:26:44.789300+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:45.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:45 smithi104 bash[15781]: audit 2024-09-15T03:26:44.795422+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:46.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:46 smithi053 bash[15077]: cluster 2024-09-15T03:26:45.148500+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-15T03:26:46.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:46 smithi053 bash[21662]: cluster 2024-09-15T03:26:45.148500+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-15T03:26:46.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:46 smithi104 bash[15781]: cluster 2024-09-15T03:26:45.148500+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-09-15T03:26:46.836 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:26:47.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:47 smithi053 bash[15077]: cluster 2024-09-15T03:26:46.698208+0000 mgr.y (mgr.14150) 369 : cluster [DBG] pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-15T03:26:47.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:47 smithi053 bash[21662]: cluster 2024-09-15T03:26:46.698208+0000 mgr.y (mgr.14150) 369 : cluster [DBG] pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-15T03:26:47.483 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:47 smithi104 bash[15781]: cluster 2024-09-15T03:26:46.698208+0000 mgr.y (mgr.14150) 369 : cluster [DBG] pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 126 KiB/s, 0 objects/s recovering 2024-09-15T03:26:50.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:49 smithi053 bash[15077]: cluster 2024-09-15T03:26:48.698665+0000 mgr.y (mgr.14150) 370 : cluster [DBG] pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T03:26:50.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:49 smithi053 bash[21662]: cluster 2024-09-15T03:26:48.698665+0000 mgr.y (mgr.14150) 370 : cluster [DBG] pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T03:26:50.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:49 smithi104 bash[15781]: cluster 2024-09-15T03:26:48.698665+0000 mgr.y (mgr.14150) 370 : cluster [DBG] pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T03:26:50.572 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:26:50.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:50 smithi053 bash[15077]: audit 2024-09-15T03:26:50.570612+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.53:0/3633516328' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T03:26:50.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:50 smithi053 bash[21662]: audit 2024-09-15T03:26:50.570612+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.53:0/3633516328' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T03:26:51.225 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1726370801,"num_in_osds":8,"osd_in_since":1726370770,"num_remapped_pgs":0} 2024-09-15T03:26:51.226 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T03:26:51.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:50 smithi104 bash[15781]: audit 2024-09-15T03:26:50.570612+0000 mon.c (mon.2) 8 : audit [DBG] from='client.? 172.21.15.53:0/3633516328' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T03:26:52.025 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:51 smithi104 bash[15781]: cluster 2024-09-15T03:26:50.699215+0000 mgr.y (mgr.14150) 371 : cluster [DBG] pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T03:26:52.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:51 smithi053 bash[15077]: cluster 2024-09-15T03:26:50.699215+0000 mgr.y (mgr.14150) 371 : cluster [DBG] pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T03:26:52.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:51 smithi053 bash[21662]: cluster 2024-09-15T03:26:50.699215+0000 mgr.y (mgr.14150) 371 : cluster [DBG] pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-09-15T03:26:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:53 smithi053 bash[15077]: cluster 2024-09-15T03:26:52.699821+0000 mgr.y (mgr.14150) 372 : cluster [DBG] pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T03:26:54.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:53 smithi053 bash[21662]: cluster 2024-09-15T03:26:52.699821+0000 mgr.y (mgr.14150) 372 : cluster [DBG] pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T03:26:54.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:53 smithi104 bash[15781]: cluster 2024-09-15T03:26:52.699821+0000 mgr.y (mgr.14150) 372 : cluster [DBG] pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-15T03:26:55.993 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:26:56.095 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:55 smithi053 bash[21662]: cluster 2024-09-15T03:26:54.700394+0000 mgr.y (mgr.14150) 373 : cluster [DBG] pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:26:56.095 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:55 smithi053 bash[21662]: audit 2024-09-15T03:26:55.756290+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:56.095 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:55 smithi053 bash[21662]: audit 2024-09-15T03:26:55.762270+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:56.095 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:55 smithi053 bash[15077]: cluster 2024-09-15T03:26:54.700394+0000 mgr.y (mgr.14150) 373 : cluster [DBG] pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:26:56.095 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:55 smithi053 bash[15077]: audit 2024-09-15T03:26:55.756290+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:56.095 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:55 smithi053 bash[15077]: audit 2024-09-15T03:26:55.762270+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:56.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:55 smithi104 bash[15781]: cluster 2024-09-15T03:26:54.700394+0000 mgr.y (mgr.14150) 373 : cluster [DBG] pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T03:26:56.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:55 smithi104 bash[15781]: audit 2024-09-15T03:26:55.756290+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:56.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:55 smithi104 bash[15781]: audit 2024-09-15T03:26:55.762270+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:56.983 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:56 smithi104 bash[15781]: audit 2024-09-15T03:26:55.769896+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:57.052 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:56 smithi053 bash[15077]: audit 2024-09-15T03:26:55.769896+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:57.053 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:56 smithi053 bash[21662]: audit 2024-09-15T03:26:55.769896+0000 mon.a (mon.0) 888 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:26:58.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:57 smithi053 bash[15077]: cluster 2024-09-15T03:26:56.701057+0000 mgr.y (mgr.14150) 374 : cluster [DBG] pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T03:26:58.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:57 smithi053 bash[21662]: cluster 2024-09-15T03:26:56.701057+0000 mgr.y (mgr.14150) 374 : cluster [DBG] pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T03:26:58.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:57 smithi104 bash[15781]: cluster 2024-09-15T03:26:56.701057+0000 mgr.y (mgr.14150) 374 : cluster [DBG] pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-15T03:26:59.378 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:26:59.379 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":58,"fsid":"aed93852-7310-11ef-bceb-c7b262605968","created":"2024-09-15T03:16:02.948210+0000","modified":"2024-09-15T03:26:45.141090+0000","last_up_change":"2024-09-15T03:26:41.098600+0000","last_in_change":"2024-09-15T03:26:10.205904+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T03:21:44.024345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"979ed5a1-4f04-4b3d-8cde-e20ffdacd018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6803","nonce":3384339896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6805","nonce":3384339896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6809","nonce":3384339896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6807","nonce":3384339896}]},"public_addr":"172.21.15.53:6803/3384339896","cluster_addr":"172.21.15.53:6805/3384339896","heartbeat_back_addr":"172.21.15.53:6809/3384339896","heartbeat_front_addr":"172.21.15.53:6807/3384339896","state":["exists","up"]},{"osd":1,"uuid":"404e0f2b-d138-4c1a-a29c-9b33c3d56c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6811","nonce":2958260182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6813","nonce":2958260182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6817","nonce":2958260182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6815","nonce":2958260182}]},"public_addr":"172.21.15.53:6811/2958260182","cluster_addr":"172.21.15.53:6813/2958260182","heartbeat_back_addr":"172.21.15.53:6817/2958260182","heartbeat_front_addr":"172.21.15.53:6815/2958260182","state":["exists","up"]},{"osd":2,"uuid":"46f21d02-74d9-4af2-9404-bd0388c25103","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6819","nonce":3584076472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6821","nonce":3584076472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6825","nonce":3584076472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6823","nonce":3584076472}]},"public_addr":"172.21.15.53:6819/3584076472","cluster_addr":"172.21.15.53:6821/3584076472","heartbeat_back_addr":"172.21.15.53:6825/3584076472","heartbeat_front_addr":"172.21.15.53:6823/3584076472","state":["exists","up"]},{"osd":3,"uuid":"89da8702-b0ab-4acc-89dc-8e53d40e80bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6827","nonce":418709263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6829","nonce":418709263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6833","nonce":418709263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6831","nonce":418709263}]},"public_addr":"172.21.15.53:6827/418709263","cluster_addr":"172.21.15.53:6829/418709263","heartbeat_back_addr":"172.21.15.53:6833/418709263","heartbeat_front_addr":"172.21.15.53:6831/418709263","state":["exists","up"]},{"osd":4,"uuid":"006ec282-23db-4141-b688-4a95655e74a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6801","nonce":3793887825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6803","nonce":3793887825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6807","nonce":3793887825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6805","nonce":3793887825}]},"public_addr":"172.21.15.104:6801/3793887825","cluster_addr":"172.21.15.104:6803/3793887825","heartbeat_back_addr":"172.21.15.104:6807/3793887825","heartbeat_front_addr":"172.21.15.104:6805/3793887825","state":["exists","up"]},{"osd":5,"uuid":"8cb3c0d1-577c-4dcc-aa8a-543858692116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6809","nonce":1629567730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6811","nonce":1629567730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6815","nonce":1629567730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6813","nonce":1629567730}]},"public_addr":"172.21.15.104:6809/1629567730","cluster_addr":"172.21.15.104:6811/1629567730","heartbeat_back_addr":"172.21.15.104:6815/1629567730","heartbeat_front_addr":"172.21.15.104:6813/1629567730","state":["exists","up"]},{"osd":6,"uuid":"1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6817","nonce":1526170749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6819","nonce":1526170749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6823","nonce":1526170749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6821","nonce":1526170749}]},"public_addr":"172.21.15.104:6817/1526170749","cluster_addr":"172.21.15.104:6819/1526170749","heartbeat_back_addr":"172.21.15.104:6823/1526170749","heartbeat_front_addr":"172.21.15.104:6821/1526170749","state":["exists","up"]},{"osd":7,"uuid":"31d4fbee-353b-4551-8c13-9e3d7bc06df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6825","nonce":760848612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6827","nonce":760848612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6831","nonce":760848612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6829","nonce":760848612}]},"public_addr":"172.21.15.104:6825/760848612","cluster_addr":"172.21.15.104:6827/760848612","heartbeat_back_addr":"172.21.15.104:6831/760848612","heartbeat_front_addr":"172.21.15.104:6829/760848612","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:19:49.611527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:20:48.305182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:21:41.360867+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:22:38.023361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:23:39.862596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:24:40.303806+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:25:43.369424+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:26:39.651188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/1234566788":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/4143972155":"2024-09-16T03:17:03.366758+0000","172.21.15.53:6800/2710749493":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/1734477862":"2024-09-16T03:17:03.366758+0000","172.21.15.53:6800/3102449096":"2024-09-16T03:16:30.414782+0000","172.21.15.53:0/59274638":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6801/2710749493":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/883853116":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6801/3102449096":"2024-09-16T03:16:30.414782+0000","172.21.15.53:0/1779232001":"2024-09-16T03:16:30.414782+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T03:26:59.978 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T03:21:44.024345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-15T03:26:59.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T03:27:00.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:59 smithi053 bash[21662]: cluster 2024-09-15T03:26:58.701627+0000 mgr.y (mgr.14150) 375 : cluster [DBG] pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:00.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:26:59 smithi053 bash[21662]: audit 2024-09-15T03:26:59.375364+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.15.53:0/625844790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:27:00.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:59 smithi053 bash[15077]: cluster 2024-09-15T03:26:58.701627+0000 mgr.y (mgr.14150) 375 : cluster [DBG] pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:00.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:26:59 smithi053 bash[15077]: audit 2024-09-15T03:26:59.375364+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.15.53:0/625844790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:27:00.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:59 smithi104 bash[15781]: cluster 2024-09-15T03:26:58.701627+0000 mgr.y (mgr.14150) 375 : cluster [DBG] pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:00.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:26:59 smithi104 bash[15781]: audit 2024-09-15T03:26:59.375364+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.15.53:0/625844790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:27:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:01 smithi053 bash[15077]: cluster 2024-09-15T03:27:00.702166+0000 mgr.y (mgr.14150) 376 : cluster [DBG] pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:02.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:01 smithi053 bash[21662]: cluster 2024-09-15T03:27:00.702166+0000 mgr.y (mgr.14150) 376 : cluster [DBG] pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:02.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:01 smithi104 bash[15781]: cluster 2024-09-15T03:27:00.702166+0000 mgr.y (mgr.14150) 376 : cluster [DBG] pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:04.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:03 smithi053 bash[15077]: cluster 2024-09-15T03:27:02.702756+0000 mgr.y (mgr.14150) 377 : cluster [DBG] pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:04.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:03 smithi053 bash[21662]: cluster 2024-09-15T03:27:02.702756+0000 mgr.y (mgr.14150) 377 : cluster [DBG] pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:04.233 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:03 smithi104 bash[15781]: cluster 2024-09-15T03:27:02.702756+0000 mgr.y (mgr.14150) 377 : cluster [DBG] pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:04.747 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[15077]: cluster 2024-09-15T03:27:04.703358+0000 mgr.y (mgr.14150) 378 : cluster [DBG] pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[15077]: audit 2024-09-15T03:27:04.981645+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[15077]: audit 2024-09-15T03:27:04.987576+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[15077]: audit 2024-09-15T03:27:04.994198+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[21662]: cluster 2024-09-15T03:27:04.703358+0000 mgr.y (mgr.14150) 378 : cluster [DBG] pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[21662]: audit 2024-09-15T03:27:04.981645+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[21662]: audit 2024-09-15T03:27:04.987576+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:05 smithi053 bash[21662]: audit 2024-09-15T03:27:04.994198+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:05 smithi104 bash[15781]: cluster 2024-09-15T03:27:04.703358+0000 mgr.y (mgr.14150) 378 : cluster [DBG] pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:06.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:05 smithi104 bash[15781]: audit 2024-09-15T03:27:04.981645+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:05 smithi104 bash[15781]: audit 2024-09-15T03:27:04.987576+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:06.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:05 smithi104 bash[15781]: audit 2024-09-15T03:27:04.994198+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:08.079 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:07 smithi053 bash[21662]: cluster 2024-09-15T03:27:06.704054+0000 mgr.y (mgr.14150) 379 : cluster [DBG] pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:08.080 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:07 smithi053 bash[15077]: cluster 2024-09-15T03:27:06.704054+0000 mgr.y (mgr.14150) 379 : cluster [DBG] pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:08.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:07 smithi104 bash[15781]: cluster 2024-09-15T03:27:06.704054+0000 mgr.y (mgr.14150) 379 : cluster [DBG] pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:09.501 INFO:teuthology.orchestra.run.smithi053.stdout:pg_num: 1 2024-09-15T03:27:09.940 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:09 smithi053 bash[15077]: cluster 2024-09-15T03:27:08.704717+0000 mgr.y (mgr.14150) 380 : cluster [DBG] pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:09.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:09 smithi053 bash[15077]: audit 2024-09-15T03:27:09.499742+0000 mon.a (mon.0) 893 : audit [DBG] from='client.? 172.21.15.53:0/1078475847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T03:27:09.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:09 smithi053 bash[21662]: cluster 2024-09-15T03:27:08.704717+0000 mgr.y (mgr.14150) 380 : cluster [DBG] pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:09.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:09 smithi053 bash[21662]: audit 2024-09-15T03:27:09.499742+0000 mon.a (mon.0) 893 : audit [DBG] from='client.? 172.21.15.53:0/1078475847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T03:27:10.199 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:09 smithi104 bash[15781]: cluster 2024-09-15T03:27:08.704717+0000 mgr.y (mgr.14150) 380 : cluster [DBG] pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:10.199 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:09 smithi104 bash[15781]: audit 2024-09-15T03:27:09.499742+0000 mon.a (mon.0) 893 : audit [DBG] from='client.? 172.21.15.53:0/1078475847' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T03:27:10.636 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi053 2024-09-15T03:27:10.636 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply rgw foo.a --placement '1;smithi053=foo.a' 2024-09-15T03:27:12.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:11 smithi053 bash[15077]: cluster 2024-09-15T03:27:10.705330+0000 mgr.y (mgr.14150) 381 : cluster [DBG] pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:11 smithi053 bash[21662]: cluster 2024-09-15T03:27:10.705330+0000 mgr.y (mgr.14150) 381 : cluster [DBG] pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:12.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:11 smithi104 bash[15781]: cluster 2024-09-15T03:27:10.705330+0000 mgr.y (mgr.14150) 381 : cluster [DBG] pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:14.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:13 smithi053 bash[15077]: cluster 2024-09-15T03:27:12.705925+0000 mgr.y (mgr.14150) 382 : cluster [DBG] pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:14.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:13 smithi053 bash[21662]: cluster 2024-09-15T03:27:12.705925+0000 mgr.y (mgr.14150) 382 : cluster [DBG] pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:14.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:13 smithi104 bash[15781]: cluster 2024-09-15T03:27:12.705925+0000 mgr.y (mgr.14150) 382 : cluster [DBG] pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:15.772 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:27:16.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:15 smithi053 bash[15077]: cluster 2024-09-15T03:27:14.706498+0000 mgr.y (mgr.14150) 383 : cluster [DBG] pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:16.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:15 smithi053 bash[21662]: cluster 2024-09-15T03:27:14.706498+0000 mgr.y (mgr.14150) 383 : cluster [DBG] pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:16.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:15 smithi104 bash[15781]: cluster 2024-09-15T03:27:14.706498+0000 mgr.y (mgr.14150) 383 : cluster [DBG] pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:17.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:16 smithi104 bash[15781]: audit 2024-09-15T03:27:15.962100+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:16 smithi104 bash[15781]: audit 2024-09-15T03:27:15.968963+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:16 smithi104 bash[15781]: audit 2024-09-15T03:27:15.975426+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:16 smithi104 bash[15781]: cluster 2024-09-15T03:27:16.707175+0000 mgr.y (mgr.14150) 384 : cluster [DBG] pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[15077]: audit 2024-09-15T03:27:15.962100+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[15077]: audit 2024-09-15T03:27:15.968963+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[15077]: audit 2024-09-15T03:27:15.975426+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[15077]: cluster 2024-09-15T03:27:16.707175+0000 mgr.y (mgr.14150) 384 : cluster [DBG] pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[21662]: audit 2024-09-15T03:27:15.962100+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[21662]: audit 2024-09-15T03:27:15.968963+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[21662]: audit 2024-09-15T03:27:15.975426+0000 mon.a (mon.0) 896 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:17.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:16 smithi053 bash[21662]: cluster 2024-09-15T03:27:16.707175+0000 mgr.y (mgr.14150) 384 : cluster [DBG] pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:19.048 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled rgw.foo.a update... 2024-09-15T03:27:19.788 DEBUG:teuthology.orchestra.run.smithi053:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@rgw.foo.a.service 2024-09-15T03:27:19.790 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi104 2024-09-15T03:27:19.791 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd pool create datapool 3 3 replicated 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: cluster 2024-09-15T03:27:18.707742+0000 mgr.y (mgr.14150) 385 : cluster [DBG] pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.046282+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.047698+0000 mon.a (mon.0) 898 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.351400+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.358293+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.359910+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.361101+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.367973+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.372359+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.377590+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-15T03:27:20.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.383644+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[21662]: audit 2024-09-15T03:27:19.384957+0000 mon.a (mon.0) 907 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: cluster 2024-09-15T03:27:18.707742+0000 mgr.y (mgr.14150) 385 : cluster [DBG] pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.046282+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.047698+0000 mon.a (mon.0) 898 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.351400+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.358293+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.359910+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.361101+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.367973+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.372359+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-15T03:27:20.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.377590+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-15T03:27:20.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.383644+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:19 smithi053 bash[15077]: audit 2024-09-15T03:27:19.384957+0000 mon.a (mon.0) 907 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:20.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: cluster 2024-09-15T03:27:18.707742+0000 mgr.y (mgr.14150) 385 : cluster [DBG] pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:20.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.046282+0000 mon.a (mon.0) 897 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.047698+0000 mon.a (mon.0) 898 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.351400+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.358293+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.359910+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.361101+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.367973+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.372359+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.377590+0000 mon.a (mon.0) 905 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.383644+0000 mon.a (mon.0) 906 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:19 smithi104 bash[15781]: audit 2024-09-15T03:27:19.384957+0000 mon.a (mon.0) 907 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:20.709 INFO:journalctl@ceph.rgw.foo.a.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:27:21.037 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:20 smithi053 bash[21662]: audit 2024-09-15T03:27:19.036021+0000 mgr.y (mgr.14150) 386 : audit [DBG] from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi053=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:27:21.037 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:20 smithi053 bash[21662]: cephadm 2024-09-15T03:27:19.039508+0000 mgr.y (mgr.14150) 387 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi053=foo.a;count:1 2024-09-15T03:27:21.037 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:20 smithi053 bash[21662]: cephadm 2024-09-15T03:27:19.386498+0000 mgr.y (mgr.14150) 388 : cephadm [INF] Deploying daemon rgw.foo.a on smithi053 2024-09-15T03:27:21.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:20 smithi053 bash[15077]: audit 2024-09-15T03:27:19.036021+0000 mgr.y (mgr.14150) 386 : audit [DBG] from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi053=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:27:21.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:20 smithi053 bash[15077]: cephadm 2024-09-15T03:27:19.039508+0000 mgr.y (mgr.14150) 387 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi053=foo.a;count:1 2024-09-15T03:27:21.037 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:20 smithi053 bash[15077]: cephadm 2024-09-15T03:27:19.386498+0000 mgr.y (mgr.14150) 388 : cephadm [INF] Deploying daemon rgw.foo.a on smithi053 2024-09-15T03:27:21.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:20 smithi104 bash[15781]: audit 2024-09-15T03:27:19.036021+0000 mgr.y (mgr.14150) 386 : audit [DBG] from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi053=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:27:21.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:20 smithi104 bash[15781]: cephadm 2024-09-15T03:27:19.039508+0000 mgr.y (mgr.14150) 387 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi053=foo.a;count:1 2024-09-15T03:27:21.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:20 smithi104 bash[15781]: cephadm 2024-09-15T03:27:19.386498+0000 mgr.y (mgr.14150) 388 : cephadm [INF] Deploying daemon rgw.foo.a on smithi053 2024-09-15T03:27:22.027 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:21 smithi053 bash[21662]: cluster 2024-09-15T03:27:20.708369+0000 mgr.y (mgr.14150) 389 : cluster [DBG] pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:22.027 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:21 smithi053 bash[15077]: cluster 2024-09-15T03:27:20.708369+0000 mgr.y (mgr.14150) 389 : cluster [DBG] pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:22.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:21 smithi104 bash[15781]: cluster 2024-09-15T03:27:20.708369+0000 mgr.y (mgr.14150) 389 : cluster [DBG] pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:23.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.327528+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.335514+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.341952+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: cephadm 2024-09-15T03:27:22.343212+0000 mgr.y (mgr.14150) 390 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi053=foo.a;count:1 2024-09-15T03:27:23.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.348018+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.352223+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.389802+0000 mon.a (mon.0) 913 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.392887+0000 mon.a (mon.0) 914 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: audit 2024-09-15T03:27:22.394034+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: cephadm 2024-09-15T03:27:22.398910+0000 mgr.y (mgr.14150) 391 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[15077]: cluster 2024-09-15T03:27:22.708794+0000 mgr.y (mgr.14150) 392 : cluster [DBG] pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.327528+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.335514+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.341952+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: cephadm 2024-09-15T03:27:22.343212+0000 mgr.y (mgr.14150) 390 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi053=foo.a;count:1 2024-09-15T03:27:23.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.348018+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.352223+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.389802+0000 mon.a (mon.0) 913 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:23.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.392887+0000 mon.a (mon.0) 914 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:23.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: audit 2024-09-15T03:27:22.394034+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:23.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: cephadm 2024-09-15T03:27:22.398910+0000 mgr.y (mgr.14150) 391 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-15T03:27:23.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:23 smithi053 bash[21662]: cluster 2024-09-15T03:27:22.708794+0000 mgr.y (mgr.14150) 392 : cluster [DBG] pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.327528+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.335514+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.341952+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: cephadm 2024-09-15T03:27:22.343212+0000 mgr.y (mgr.14150) 390 : cephadm [INF] Saving service rgw.foo.a spec with placement smithi053=foo.a;count:1 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.348018+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.352223+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.389802+0000 mon.a (mon.0) 913 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:23.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.392887+0000 mon.a (mon.0) 914 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:23.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: audit 2024-09-15T03:27:22.394034+0000 mon.a (mon.0) 915 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:23.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: cephadm 2024-09-15T03:27:22.398910+0000 mgr.y (mgr.14150) 391 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-15T03:27:23.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:23 smithi104 bash[15781]: cluster 2024-09-15T03:27:22.708794+0000 mgr.y (mgr.14150) 392 : cluster [DBG] pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:24.538 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[21662]: cluster 2024-09-15T03:27:23.360648+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-15T03:27:24.539 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[21662]: audit 2024-09-15T03:27:23.363210+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.53:0/41394001' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-15T03:27:24.539 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[21662]: audit 2024-09-15T03:27:23.363883+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-15T03:27:24.539 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[21662]: audit 2024-09-15T03:27:23.537696+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:24.539 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[15077]: cluster 2024-09-15T03:27:23.360648+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-15T03:27:24.539 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[15077]: audit 2024-09-15T03:27:23.363210+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.53:0/41394001' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-15T03:27:24.539 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[15077]: audit 2024-09-15T03:27:23.363883+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-15T03:27:24.539 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:24 smithi053 bash[15077]: audit 2024-09-15T03:27:23.537696+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:24.547 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:27:24.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:24 smithi104 bash[15781]: cluster 2024-09-15T03:27:23.360648+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-09-15T03:27:24.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:24 smithi104 bash[15781]: audit 2024-09-15T03:27:23.363210+0000 mon.c (mon.2) 9 : audit [INF] from='client.? 172.21.15.53:0/41394001' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-15T03:27:24.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:24 smithi104 bash[15781]: audit 2024-09-15T03:27:23.363883+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-15T03:27:24.651 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:24 smithi104 bash[15781]: audit 2024-09-15T03:27:23.537696+0000 mon.a (mon.0) 918 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:25.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[15077]: audit 2024-09-15T03:27:24.368753+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-15T03:27:25.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[15077]: cluster 2024-09-15T03:27:24.369100+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-15T03:27:25.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[15077]: cluster 2024-09-15T03:27:24.709282+0000 mgr.y (mgr.14150) 393 : cluster [DBG] pgmap v365: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:25.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[15077]: audit 2024-09-15T03:27:25.351961+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:25.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[21662]: audit 2024-09-15T03:27:24.368753+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-15T03:27:25.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[21662]: cluster 2024-09-15T03:27:24.369100+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-15T03:27:25.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[21662]: cluster 2024-09-15T03:27:24.709282+0000 mgr.y (mgr.14150) 393 : cluster [DBG] pgmap v365: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:25.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:25 smithi053 bash[21662]: audit 2024-09-15T03:27:25.351961+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:25.711 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:25 smithi104 bash[15781]: audit 2024-09-15T03:27:24.368753+0000 mon.a (mon.0) 919 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-15T03:27:25.711 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:25 smithi104 bash[15781]: cluster 2024-09-15T03:27:24.369100+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-09-15T03:27:25.711 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:25 smithi104 bash[15781]: cluster 2024-09-15T03:27:24.709282+0000 mgr.y (mgr.14150) 393 : cluster [DBG] pgmap v365: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:25.711 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:25 smithi104 bash[15781]: audit 2024-09-15T03:27:25.351961+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[21662]: cluster 2024-09-15T03:27:25.378293+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[21662]: audit 2024-09-15T03:27:25.380594+0000 mon.c (mon.2) 10 : audit [INF] from='client.? 172.21.15.53:0/338615405' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[21662]: audit 2024-09-15T03:27:25.381824+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[21662]: audit 2024-09-15T03:27:25.385523+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.53:0/3490230806' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[21662]: audit 2024-09-15T03:27:25.386116+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[15077]: cluster 2024-09-15T03:27:25.378293+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[15077]: audit 2024-09-15T03:27:25.380594+0000 mon.c (mon.2) 10 : audit [INF] from='client.? 172.21.15.53:0/338615405' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.681 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[15077]: audit 2024-09-15T03:27:25.381824+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.682 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[15077]: audit 2024-09-15T03:27:25.385523+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.53:0/3490230806' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.682 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:26 smithi053 bash[15077]: audit 2024-09-15T03:27:25.386116+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:26 smithi104 bash[15781]: cluster 2024-09-15T03:27:25.378293+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-09-15T03:27:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:26 smithi104 bash[15781]: audit 2024-09-15T03:27:25.380594+0000 mon.c (mon.2) 10 : audit [INF] from='client.? 172.21.15.53:0/338615405' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:26 smithi104 bash[15781]: audit 2024-09-15T03:27:25.381824+0000 mon.a (mon.0) 923 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:26 smithi104 bash[15781]: audit 2024-09-15T03:27:25.385523+0000 mon.c (mon.2) 11 : audit [INF] from='client.? 172.21.15.53:0/3490230806' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:26.733 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:26 smithi104 bash[15781]: audit 2024-09-15T03:27:25.386116+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-15T03:27:27.647 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[21662]: audit 2024-09-15T03:27:26.382351+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-15T03:27:27.647 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[21662]: audit 2024-09-15T03:27:26.382688+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-15T03:27:27.647 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[21662]: cluster 2024-09-15T03:27:26.382818+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-15T03:27:27.647 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[21662]: cluster 2024-09-15T03:27:26.709745+0000 mgr.y (mgr.14150) 394 : cluster [DBG] pgmap v368: 65 pgs: 23 creating+peering, 20 unknown, 22 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-15T03:27:27.647 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[15077]: audit 2024-09-15T03:27:26.382351+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-15T03:27:27.648 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[15077]: audit 2024-09-15T03:27:26.382688+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-15T03:27:27.648 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[15077]: cluster 2024-09-15T03:27:26.382818+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-15T03:27:27.648 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:27 smithi053 bash[15077]: cluster 2024-09-15T03:27:26.709745+0000 mgr.y (mgr.14150) 394 : cluster [DBG] pgmap v368: 65 pgs: 23 creating+peering, 20 unknown, 22 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-15T03:27:27.667 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:27 smithi104 bash[15781]: audit 2024-09-15T03:27:26.382351+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-15T03:27:27.668 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:27 smithi104 bash[15781]: audit 2024-09-15T03:27:26.382688+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-15T03:27:27.668 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:27 smithi104 bash[15781]: cluster 2024-09-15T03:27:26.382818+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-09-15T03:27:27.668 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:27 smithi104 bash[15781]: cluster 2024-09-15T03:27:26.709745+0000 mgr.y (mgr.14150) 394 : cluster [DBG] pgmap v368: 65 pgs: 23 creating+peering, 20 unknown, 22 active+clean; 577 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-15T03:27:28.517 INFO:teuthology.orchestra.run.smithi104.stderr:pool 'datapool' created 2024-09-15T03:27:28.757 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:28 smithi104 bash[15781]: cluster 2024-09-15T03:27:27.398750+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-15T03:27:28.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:28 smithi104 bash[15781]: audit 2024-09-15T03:27:27.403436+0000 mon.c (mon.2) 12 : audit [INF] from='client.? 172.21.15.53:0/338615405' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:28 smithi104 bash[15781]: audit 2024-09-15T03:27:27.403629+0000 mon.c (mon.2) 13 : audit [INF] from='client.? 172.21.15.53:0/3490230806' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:28 smithi104 bash[15781]: audit 2024-09-15T03:27:27.409779+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.758 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:28 smithi104 bash[15781]: audit 2024-09-15T03:27:27.410024+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[15077]: cluster 2024-09-15T03:27:27.398750+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[15077]: audit 2024-09-15T03:27:27.403436+0000 mon.c (mon.2) 12 : audit [INF] from='client.? 172.21.15.53:0/338615405' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[15077]: audit 2024-09-15T03:27:27.403629+0000 mon.c (mon.2) 13 : audit [INF] from='client.? 172.21.15.53:0/3490230806' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[15077]: audit 2024-09-15T03:27:27.409779+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[15077]: audit 2024-09-15T03:27:27.410024+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[21662]: cluster 2024-09-15T03:27:27.398750+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[21662]: audit 2024-09-15T03:27:27.403436+0000 mon.c (mon.2) 12 : audit [INF] from='client.? 172.21.15.53:0/338615405' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[21662]: audit 2024-09-15T03:27:27.403629+0000 mon.c (mon.2) 13 : audit [INF] from='client.? 172.21.15.53:0/3490230806' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[21662]: audit 2024-09-15T03:27:27.409779+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:28.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:28 smithi053 bash[21662]: audit 2024-09-15T03:27:27.410024+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-15T03:27:29.246 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- rbd pool init datapool 2024-09-15T03:27:29.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[15077]: audit 2024-09-15T03:27:28.047222+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.104:0/4263603618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-15T03:27:29.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[15077]: audit 2024-09-15T03:27:28.049633+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-15T03:27:29.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[15077]: audit 2024-09-15T03:27:28.513618+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-15T03:27:29.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[15077]: audit 2024-09-15T03:27:28.513781+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-15T03:27:29.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[15077]: audit 2024-09-15T03:27:28.513912+0000 mon.a (mon.0) 934 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-15T03:27:29.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[15077]: cluster 2024-09-15T03:27:28.514008+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-15T03:27:29.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[15077]: audit 2024-09-15T03:27:28.514179+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:29.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[21662]: audit 2024-09-15T03:27:28.047222+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.104:0/4263603618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-15T03:27:29.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[21662]: audit 2024-09-15T03:27:28.049633+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-15T03:27:29.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[21662]: audit 2024-09-15T03:27:28.513618+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-15T03:27:29.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[21662]: audit 2024-09-15T03:27:28.513781+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-15T03:27:29.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[21662]: audit 2024-09-15T03:27:28.513912+0000 mon.a (mon.0) 934 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-15T03:27:29.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[21662]: cluster 2024-09-15T03:27:28.514008+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-15T03:27:29.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:29 smithi053 bash[21662]: audit 2024-09-15T03:27:28.514179+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:29.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:29 smithi104 bash[15781]: audit 2024-09-15T03:27:28.047222+0000 mon.b (mon.1) 25 : audit [INF] from='client.? 172.21.15.104:0/4263603618' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-15T03:27:29.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:29 smithi104 bash[15781]: audit 2024-09-15T03:27:28.049633+0000 mon.a (mon.0) 931 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-09-15T03:27:29.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:29 smithi104 bash[15781]: audit 2024-09-15T03:27:28.513618+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-15T03:27:29.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:29 smithi104 bash[15781]: audit 2024-09-15T03:27:28.513781+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-15T03:27:29.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:29 smithi104 bash[15781]: audit 2024-09-15T03:27:28.513912+0000 mon.a (mon.0) 934 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-09-15T03:27:29.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:29 smithi104 bash[15781]: cluster 2024-09-15T03:27:28.514008+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-09-15T03:27:29.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:29 smithi104 bash[15781]: audit 2024-09-15T03:27:28.514179+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:30.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:30 smithi104 bash[15781]: cluster 2024-09-15T03:27:28.710481+0000 mgr.y (mgr.14150) 395 : cluster [DBG] pgmap v371: 100 pgs: 19 creating+peering, 36 unknown, 45 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-15T03:27:30.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:30 smithi104 bash[15781]: cluster 2024-09-15T03:27:29.538085+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-15T03:27:30.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:30 smithi104 bash[15781]: audit 2024-09-15T03:27:29.539225+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:30 smithi104 bash[15781]: audit 2024-09-15T03:27:29.547974+0000 mon.c (mon.2) 14 : audit [INF] from='client.? 172.21.15.53:0/406740048' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:30 smithi104 bash[15781]: audit 2024-09-15T03:27:29.548344+0000 mon.a (mon.0) 939 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:30 smithi104 bash[15781]: cluster 2024-09-15T03:27:29.576304+0000 mon.a (mon.0) 940 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T03:27:30.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[15077]: cluster 2024-09-15T03:27:28.710481+0000 mgr.y (mgr.14150) 395 : cluster [DBG] pgmap v371: 100 pgs: 19 creating+peering, 36 unknown, 45 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-15T03:27:30.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[15077]: cluster 2024-09-15T03:27:29.538085+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-15T03:27:30.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[15077]: audit 2024-09-15T03:27:29.539225+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[15077]: audit 2024-09-15T03:27:29.547974+0000 mon.c (mon.2) 14 : audit [INF] from='client.? 172.21.15.53:0/406740048' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[15077]: audit 2024-09-15T03:27:29.548344+0000 mon.a (mon.0) 939 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[15077]: cluster 2024-09-15T03:27:29.576304+0000 mon.a (mon.0) 940 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T03:27:30.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[21662]: cluster 2024-09-15T03:27:28.710481+0000 mgr.y (mgr.14150) 395 : cluster [DBG] pgmap v371: 100 pgs: 19 creating+peering, 36 unknown, 45 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-15T03:27:30.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[21662]: cluster 2024-09-15T03:27:29.538085+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-09-15T03:27:30.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[21662]: audit 2024-09-15T03:27:29.539225+0000 mon.a (mon.0) 938 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[21662]: audit 2024-09-15T03:27:29.547974+0000 mon.c (mon.2) 14 : audit [INF] from='client.? 172.21.15.53:0/406740048' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[21662]: audit 2024-09-15T03:27:29.548344+0000 mon.a (mon.0) 939 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-15T03:27:30.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:30 smithi053 bash[21662]: cluster 2024-09-15T03:27:29.576304+0000 mon.a (mon.0) 940 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T03:27:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[15077]: audit 2024-09-15T03:27:30.541623+0000 mon.a (mon.0) 941 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-15T03:27:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[15077]: audit 2024-09-15T03:27:30.541889+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-15T03:27:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[15077]: cluster 2024-09-15T03:27:30.541993+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-15T03:27:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[15077]: audit 2024-09-15T03:27:30.548352+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.53:0/406740048' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[15077]: audit 2024-09-15T03:27:30.549370+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[15077]: audit 2024-09-15T03:27:30.551424+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[15077]: cluster 2024-09-15T03:27:30.711366+0000 mgr.y (mgr.14150) 396 : cluster [DBG] pgmap v374: 132 pgs: 1 creating+activating, 16 creating+peering, 54 unknown, 61 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[21662]: audit 2024-09-15T03:27:30.541623+0000 mon.a (mon.0) 941 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[21662]: audit 2024-09-15T03:27:30.541889+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[21662]: cluster 2024-09-15T03:27:30.541993+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[21662]: audit 2024-09-15T03:27:30.548352+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.53:0/406740048' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[21662]: audit 2024-09-15T03:27:30.549370+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[21662]: audit 2024-09-15T03:27:30.551424+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.945 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:31 smithi053 bash[21662]: cluster 2024-09-15T03:27:30.711366+0000 mgr.y (mgr.14150) 396 : cluster [DBG] pgmap v374: 132 pgs: 1 creating+activating, 16 creating+peering, 54 unknown, 61 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-15T03:27:31.965 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:31 smithi104 bash[15781]: audit 2024-09-15T03:27:30.541623+0000 mon.a (mon.0) 941 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-15T03:27:31.966 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:31 smithi104 bash[15781]: audit 2024-09-15T03:27:30.541889+0000 mon.a (mon.0) 942 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-15T03:27:31.966 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:31 smithi104 bash[15781]: cluster 2024-09-15T03:27:30.541993+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-09-15T03:27:31.966 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:31 smithi104 bash[15781]: audit 2024-09-15T03:27:30.548352+0000 mon.c (mon.2) 15 : audit [INF] from='client.? 172.21.15.53:0/406740048' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.966 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:31 smithi104 bash[15781]: audit 2024-09-15T03:27:30.549370+0000 mon.a (mon.0) 944 : audit [INF] from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.966 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:31 smithi104 bash[15781]: audit 2024-09-15T03:27:30.551424+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-15T03:27:31.966 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:31 smithi104 bash[15781]: cluster 2024-09-15T03:27:30.711366+0000 mgr.y (mgr.14150) 396 : cluster [DBG] pgmap v374: 132 pgs: 1 creating+activating, 16 creating+peering, 54 unknown, 61 active+clean; 578 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-09-15T03:27:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.552383+0000 mon.a (mon.0) 946 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-15T03:27:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.552620+0000 mon.a (mon.0) 947 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-15T03:27:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: cluster 2024-09-15T03:27:31.552730+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-15T03:27:32.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.625063+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.632080+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.643161+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.827006+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.839263+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.862692+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.914125+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.917097+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:31.918233+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[15077]: audit 2024-09-15T03:27:32.222273+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.552383+0000 mon.a (mon.0) 946 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.552620+0000 mon.a (mon.0) 947 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: cluster 2024-09-15T03:27:31.552730+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.625063+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.632080+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.643161+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.827006+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.839263+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.862692+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.914125+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.917097+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:31.918233+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:32.943 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:32 smithi053 bash[21662]: audit 2024-09-15T03:27:32.222273+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.552383+0000 mon.a (mon.0) 946 : audit [INF] from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-15T03:27:32.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.552620+0000 mon.a (mon.0) 947 : audit [INF] from='client.? 172.21.15.53:0/2873327947' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-15T03:27:32.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: cluster 2024-09-15T03:27:31.552730+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-09-15T03:27:32.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.625063+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.632080+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.643161+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.827006+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.839263+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.862692+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.914125+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.917097+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:31.918233+0000 mon.a (mon.0) 957 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:32.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:32 smithi104 bash[15781]: audit 2024-09-15T03:27:32.222273+0000 mon.a (mon.0) 958 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:33.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:33 smithi104 bash[15781]: cephadm 2024-09-15T03:27:31.924896+0000 mgr.y (mgr.14150) 397 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-15T03:27:33.810 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:33 smithi104 bash[15781]: cluster 2024-09-15T03:27:32.712785+0000 mgr.y (mgr.14150) 398 : cluster [DBG] pgmap v376: 132 pgs: 6 creating+activating, 2 unknown, 124 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 32 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-09-15T03:27:33.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:33 smithi053 bash[15077]: cephadm 2024-09-15T03:27:31.924896+0000 mgr.y (mgr.14150) 397 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-15T03:27:33.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:33 smithi053 bash[15077]: cluster 2024-09-15T03:27:32.712785+0000 mgr.y (mgr.14150) 398 : cluster [DBG] pgmap v376: 132 pgs: 6 creating+activating, 2 unknown, 124 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 32 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-09-15T03:27:33.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:33 smithi053 bash[21662]: cephadm 2024-09-15T03:27:31.924896+0000 mgr.y (mgr.14150) 397 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-09-15T03:27:33.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:33 smithi053 bash[21662]: cluster 2024-09-15T03:27:32.712785+0000 mgr.y (mgr.14150) 398 : cluster [DBG] pgmap v376: 132 pgs: 6 creating+activating, 2 unknown, 124 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 32 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-09-15T03:27:34.006 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:27:36.041 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:35 smithi104 bash[15781]: cluster 2024-09-15T03:27:34.713698+0000 mgr.y (mgr.14150) 399 : cluster [DBG] pgmap v377: 132 pgs: 6 creating+activating, 126 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s rd, 1.5 KiB/s wr, 46 op/s 2024-09-15T03:27:36.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:35 smithi053 bash[15077]: cluster 2024-09-15T03:27:34.713698+0000 mgr.y (mgr.14150) 399 : cluster [DBG] pgmap v377: 132 pgs: 6 creating+activating, 126 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s rd, 1.5 KiB/s wr, 46 op/s 2024-09-15T03:27:36.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:35 smithi053 bash[21662]: cluster 2024-09-15T03:27:34.713698+0000 mgr.y (mgr.14150) 399 : cluster [DBG] pgmap v377: 132 pgs: 6 creating+activating, 126 active+clean; 579 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s rd, 1.5 KiB/s wr, 46 op/s 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[21662]: audit 2024-09-15T03:27:36.146042+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[21662]: audit 2024-09-15T03:27:36.152718+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[21662]: audit 2024-09-15T03:27:36.159523+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[21662]: cluster 2024-09-15T03:27:36.715224+0000 mgr.y (mgr.14150) 400 : cluster [DBG] pgmap v378: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s rd, 5.0 KiB/s wr, 201 op/s 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[15077]: audit 2024-09-15T03:27:36.146042+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[15077]: audit 2024-09-15T03:27:36.152718+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[15077]: audit 2024-09-15T03:27:36.159523+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:37 smithi053 bash[15077]: cluster 2024-09-15T03:27:36.715224+0000 mgr.y (mgr.14150) 400 : cluster [DBG] pgmap v378: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s rd, 5.0 KiB/s wr, 201 op/s 2024-09-15T03:27:37.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:37 smithi104 bash[15781]: audit 2024-09-15T03:27:36.146042+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:37 smithi104 bash[15781]: audit 2024-09-15T03:27:36.152718+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:37 smithi104 bash[15781]: audit 2024-09-15T03:27:36.159523+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:37.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:37 smithi104 bash[15781]: cluster 2024-09-15T03:27:36.715224+0000 mgr.y (mgr.14150) 400 : cluster [DBG] pgmap v378: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s rd, 5.0 KiB/s wr, 201 op/s 2024-09-15T03:27:38.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:38 smithi104 bash[15781]: audit 2024-09-15T03:27:38.054529+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.104:0/1320850859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-15T03:27:38.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:38 smithi104 bash[15781]: audit 2024-09-15T03:27:38.056941+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-15T03:27:38.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:38 smithi053 bash[15077]: audit 2024-09-15T03:27:38.054529+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.104:0/1320850859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-15T03:27:38.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:38 smithi053 bash[15077]: audit 2024-09-15T03:27:38.056941+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-15T03:27:38.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:38 smithi053 bash[21662]: audit 2024-09-15T03:27:38.054529+0000 mon.b (mon.1) 26 : audit [INF] from='client.? 172.21.15.104:0/1320850859' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-15T03:27:38.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:38 smithi053 bash[21662]: audit 2024-09-15T03:27:38.056941+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-09-15T03:27:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:39 smithi053 bash[15077]: audit 2024-09-15T03:27:38.171012+0000 mon.a (mon.0) 963 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-15T03:27:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:39 smithi053 bash[15077]: cluster 2024-09-15T03:27:38.171101+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-15T03:27:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:39 smithi053 bash[15077]: cluster 2024-09-15T03:27:38.716036+0000 mgr.y (mgr.14150) 401 : cluster [DBG] pgmap v380: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s rd, 4.4 KiB/s wr, 202 op/s 2024-09-15T03:27:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:39 smithi053 bash[21662]: audit 2024-09-15T03:27:38.171012+0000 mon.a (mon.0) 963 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-15T03:27:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:39 smithi053 bash[21662]: cluster 2024-09-15T03:27:38.171101+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-15T03:27:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:39 smithi053 bash[21662]: cluster 2024-09-15T03:27:38.716036+0000 mgr.y (mgr.14150) 401 : cluster [DBG] pgmap v380: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s rd, 4.4 KiB/s wr, 202 op/s 2024-09-15T03:27:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:39 smithi104 bash[15781]: audit 2024-09-15T03:27:38.171012+0000 mon.a (mon.0) 963 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-09-15T03:27:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:39 smithi104 bash[15781]: cluster 2024-09-15T03:27:38.171101+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-09-15T03:27:39.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:39 smithi104 bash[15781]: cluster 2024-09-15T03:27:38.716036+0000 mgr.y (mgr.14150) 401 : cluster [DBG] pgmap v380: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 96 KiB/s rd, 4.4 KiB/s wr, 202 op/s 2024-09-15T03:27:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:40 smithi053 bash[15077]: cluster 2024-09-15T03:27:39.168219+0000 mon.a (mon.0) 965 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T03:27:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:40 smithi053 bash[15077]: cluster 2024-09-15T03:27:39.168252+0000 mon.a (mon.0) 966 : cluster [INF] Cluster is now healthy 2024-09-15T03:27:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:40 smithi053 bash[15077]: cluster 2024-09-15T03:27:39.181602+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-15T03:27:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:40 smithi053 bash[21662]: cluster 2024-09-15T03:27:39.168219+0000 mon.a (mon.0) 965 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T03:27:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:40 smithi053 bash[21662]: cluster 2024-09-15T03:27:39.168252+0000 mon.a (mon.0) 966 : cluster [INF] Cluster is now healthy 2024-09-15T03:27:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:40 smithi053 bash[21662]: cluster 2024-09-15T03:27:39.181602+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-15T03:27:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:40 smithi104 bash[15781]: cluster 2024-09-15T03:27:39.168219+0000 mon.a (mon.0) 965 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T03:27:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:40 smithi104 bash[15781]: cluster 2024-09-15T03:27:39.168252+0000 mon.a (mon.0) 966 : cluster [INF] Cluster is now healthy 2024-09-15T03:27:40.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:40 smithi104 bash[15781]: cluster 2024-09-15T03:27:39.181602+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2024-09-15T03:27:40.970 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.104 --placement '1;smithi104=iscsi.a' 2024-09-15T03:27:41.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:41 smithi104 bash[15781]: cluster 2024-09-15T03:27:40.185633+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-15T03:27:41.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:41 smithi104 bash[15781]: cluster 2024-09-15T03:27:40.716921+0000 mgr.y (mgr.14150) 402 : cluster [DBG] pgmap v383: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 109 KiB/s rd, 4.7 KiB/s wr, 229 op/s 2024-09-15T03:27:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:41 smithi053 bash[21662]: cluster 2024-09-15T03:27:40.185633+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-15T03:27:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:41 smithi053 bash[21662]: cluster 2024-09-15T03:27:40.716921+0000 mgr.y (mgr.14150) 402 : cluster [DBG] pgmap v383: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 109 KiB/s rd, 4.7 KiB/s wr, 229 op/s 2024-09-15T03:27:41.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:41 smithi053 bash[15077]: cluster 2024-09-15T03:27:40.185633+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-09-15T03:27:41.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:41 smithi053 bash[15077]: cluster 2024-09-15T03:27:40.716921+0000 mgr.y (mgr.14150) 402 : cluster [DBG] pgmap v383: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 109 KiB/s rd, 4.7 KiB/s wr, 229 op/s 2024-09-15T03:27:44.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:43 smithi053 bash[15077]: cluster 2024-09-15T03:27:42.718267+0000 mgr.y (mgr.14150) 403 : cluster [DBG] pgmap v384: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 KiB/s rd, 170 B/s wr, 45 op/s 2024-09-15T03:27:44.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:43 smithi053 bash[21662]: cluster 2024-09-15T03:27:42.718267+0000 mgr.y (mgr.14150) 403 : cluster [DBG] pgmap v384: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 KiB/s rd, 170 B/s wr, 45 op/s 2024-09-15T03:27:44.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:43 smithi104 bash[15781]: cluster 2024-09-15T03:27:42.718267+0000 mgr.y (mgr.14150) 403 : cluster [DBG] pgmap v384: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 KiB/s rd, 170 B/s wr, 45 op/s 2024-09-15T03:27:45.730 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:27:46.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:45 smithi053 bash[15077]: cluster 2024-09-15T03:27:44.718756+0000 mgr.y (mgr.14150) 404 : cluster [DBG] pgmap v385: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.8 KiB/s rd, 156 B/s wr, 14 op/s 2024-09-15T03:27:46.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:45 smithi053 bash[21662]: cluster 2024-09-15T03:27:44.718756+0000 mgr.y (mgr.14150) 404 : cluster [DBG] pgmap v385: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.8 KiB/s rd, 156 B/s wr, 14 op/s 2024-09-15T03:27:46.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:45 smithi104 bash[15781]: cluster 2024-09-15T03:27:44.718756+0000 mgr.y (mgr.14150) 404 : cluster [DBG] pgmap v385: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.8 KiB/s rd, 156 B/s wr, 14 op/s 2024-09-15T03:27:47.986 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:47 smithi104 bash[15781]: cluster 2024-09-15T03:27:46.719967+0000 mgr.y (mgr.14150) 405 : cluster [DBG] pgmap v386: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-15T03:27:48.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:47 smithi053 bash[15077]: cluster 2024-09-15T03:27:46.719967+0000 mgr.y (mgr.14150) 405 : cluster [DBG] pgmap v386: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-15T03:27:48.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:47 smithi053 bash[21662]: cluster 2024-09-15T03:27:46.719967+0000 mgr.y (mgr.14150) 405 : cluster [DBG] pgmap v386: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-15T03:27:49.117 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled iscsi.datapool update... 2024-09-15T03:27:50.017 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-09-15T03:27:50.018 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:27:50.018 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-15T03:27:50.030 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:27:50.030 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-09-15T03:27:50.045 DEBUG:teuthology.orchestra.run.smithi104:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@iscsi.iscsi.a.service 2024-09-15T03:27:50.088 INFO:tasks.cephadm:Adding prometheus.a on smithi104 2024-09-15T03:27:50.088 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply prometheus '1;smithi104=a' 2024-09-15T03:27:50.098 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: cluster 2024-09-15T03:27:48.720969+0000 mgr.y (mgr.14150) 406 : cluster [DBG] pgmap v387: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 214 B/s wr, 10 op/s 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.114707+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.116125+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.394444+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.401376+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.403083+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.404555+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.412832+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.418124+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-15T03:27:50.099 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.423374+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-15T03:27:50.100 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:49 smithi104 bash[15781]: audit 2024-09-15T03:27:49.436201+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:50.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: cluster 2024-09-15T03:27:48.720969+0000 mgr.y (mgr.14150) 406 : cluster [DBG] pgmap v387: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 214 B/s wr, 10 op/s 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.114707+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.116125+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.394444+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.401376+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.403083+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.404555+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.412832+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.418124+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.423374+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-15T03:27:50.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[15077]: audit 2024-09-15T03:27:49.436201+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: cluster 2024-09-15T03:27:48.720969+0000 mgr.y (mgr.14150) 406 : cluster [DBG] pgmap v387: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 6.7 KiB/s rd, 214 B/s wr, 10 op/s 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.114707+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.116125+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.394444+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.401376+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.403083+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.404555+0000 mon.a (mon.0) 974 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.412832+0000 mon.a (mon.0) 975 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.418124+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.423374+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-09-15T03:27:50.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:49 smithi053 bash[21662]: audit 2024-09-15T03:27:49.436201+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:50.738 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:27:51.152 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:50 smithi104 bash[15781]: audit 2024-09-15T03:27:49.102079+0000 mgr.y (mgr.14150) 407 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.104", "placement": "1;smithi104=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:27:51.152 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:50 smithi104 bash[15781]: cephadm 2024-09-15T03:27:49.107497+0000 mgr.y (mgr.14150) 408 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi104=iscsi.a;count:1 2024-09-15T03:27:51.152 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:50 smithi104 bash[15781]: cephadm 2024-09-15T03:27:49.437826+0000 mgr.y (mgr.14150) 409 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi104 2024-09-15T03:27:51.152 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:50 smithi104 bash[15781]: cluster 2024-09-15T03:27:49.917362+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-15T03:27:51.152 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:50 smithi104 bash[15781]: audit 2024-09-15T03:27:50.325020+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.152 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:50 smithi104 bash[15781]: audit 2024-09-15T03:27:50.331850+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.152 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:50 smithi104 bash[15781]: audit 2024-09-15T03:27:50.341188+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[15077]: audit 2024-09-15T03:27:49.102079+0000 mgr.y (mgr.14150) 407 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.104", "placement": "1;smithi104=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:27:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[15077]: cephadm 2024-09-15T03:27:49.107497+0000 mgr.y (mgr.14150) 408 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi104=iscsi.a;count:1 2024-09-15T03:27:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[15077]: cephadm 2024-09-15T03:27:49.437826+0000 mgr.y (mgr.14150) 409 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi104 2024-09-15T03:27:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[15077]: cluster 2024-09-15T03:27:49.917362+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-15T03:27:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[15077]: audit 2024-09-15T03:27:50.325020+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[15077]: audit 2024-09-15T03:27:50.331850+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[15077]: audit 2024-09-15T03:27:50.341188+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[21662]: audit 2024-09-15T03:27:49.102079+0000 mgr.y (mgr.14150) 407 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.104", "placement": "1;smithi104=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:27:51.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[21662]: cephadm 2024-09-15T03:27:49.107497+0000 mgr.y (mgr.14150) 408 : cephadm [INF] Saving service iscsi.datapool spec with placement smithi104=iscsi.a;count:1 2024-09-15T03:27:51.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[21662]: cephadm 2024-09-15T03:27:49.437826+0000 mgr.y (mgr.14150) 409 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi104 2024-09-15T03:27:51.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[21662]: cluster 2024-09-15T03:27:49.917362+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-09-15T03:27:51.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[21662]: audit 2024-09-15T03:27:50.325020+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[21662]: audit 2024-09-15T03:27:50.331850+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:51.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:50 smithi053 bash[21662]: audit 2024-09-15T03:27:50.341188+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:52.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:51 smithi053 bash[15077]: cluster 2024-09-15T03:27:50.721756+0000 mgr.y (mgr.14150) 410 : cluster [DBG] pgmap v389: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.8 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-15T03:27:52.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:51 smithi053 bash[21662]: cluster 2024-09-15T03:27:50.721756+0000 mgr.y (mgr.14150) 410 : cluster [DBG] pgmap v389: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.8 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-15T03:27:52.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:51 smithi104 bash[15781]: cluster 2024-09-15T03:27:50.721756+0000 mgr.y (mgr.14150) 410 : cluster [DBG] pgmap v389: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 4.8 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-15T03:27:53.161 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:52 smithi104 systemd[1]: Started Ceph iscsi.iscsi.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:27:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: cluster 2024-09-15T03:27:52.723055+0000 mgr.y (mgr.14150) 411 : cluster [DBG] pgmap v390: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-15T03:27:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:52.933801+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:52.939676+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:52.945592+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:52.962008+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.002716+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.005727+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.007106+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.014444+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.059586+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.063069+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.071421+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.080819+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi104"}]: dispatch 2024-09-15T03:27:54.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.089809+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.091530+0000 mon.a (mon.0) 996 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.093919+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.094782+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.100185+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[15077]: audit 2024-09-15T03:27:53.545991+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: cluster 2024-09-15T03:27:52.723055+0000 mgr.y (mgr.14150) 411 : cluster [DBG] pgmap v390: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:52.933801+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:52.939676+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:52.945592+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:52.962008+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.002716+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.005727+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.007106+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.014444+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.059586+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.063069+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.071421+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.080819+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi104"}]: dispatch 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.089809+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.091530+0000 mon.a (mon.0) 996 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:54.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.093919+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:54.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.094782+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:54.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.100185+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:53 smithi053 bash[21662]: audit 2024-09-15T03:27:53.545991+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: cluster 2024-09-15T03:27:52.723055+0000 mgr.y (mgr.14150) 411 : cluster [DBG] pgmap v390: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:52.933801+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:52.939676+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:52.945592+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:52.962008+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.002716+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.005727+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.007106+0000 mon.a (mon.0) 989 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.014444+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.059586+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.063069+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.071421+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.080819+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi104"}]: dispatch 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.089809+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.091530+0000 mon.a (mon.0) 996 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.093919+0000 mon.a (mon.0) 997 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.094782+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.100185+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:54.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:53 smithi104 bash[15781]: audit 2024-09-15T03:27:53.545991+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:55.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: cephadm 2024-09-15T03:27:52.946658+0000 mgr.y (mgr.14150) 412 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-15T03:27:55.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: cephadm 2024-09-15T03:27:53.015009+0000 mgr.y (mgr.14150) 413 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:27:55.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: audit 2024-09-15T03:27:53.060910+0000 mgr.y (mgr.14150) 414 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-15T03:27:55.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: cephadm 2024-09-15T03:27:53.062640+0000 mgr.y (mgr.14150) 415 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.104:5000 to Dashboard 2024-09-15T03:27:55.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: audit 2024-09-15T03:27:53.063937+0000 mgr.y (mgr.14150) 416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-15T03:27:55.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: audit 2024-09-15T03:27:53.081624+0000 mgr.y (mgr.14150) 417 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi104"}]: dispatch 2024-09-15T03:27:55.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: cephadm 2024-09-15T03:27:53.100639+0000 mgr.y (mgr.14150) 418 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[15077]: cluster 2024-09-15T03:27:53.975942+0000 mon.a (mon.0) 1001 : cluster [DBG] mgrmap e16: y(active, since 10m), standbys: x 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: cephadm 2024-09-15T03:27:52.946658+0000 mgr.y (mgr.14150) 412 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: cephadm 2024-09-15T03:27:53.015009+0000 mgr.y (mgr.14150) 413 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: audit 2024-09-15T03:27:53.060910+0000 mgr.y (mgr.14150) 414 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: cephadm 2024-09-15T03:27:53.062640+0000 mgr.y (mgr.14150) 415 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.104:5000 to Dashboard 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: audit 2024-09-15T03:27:53.063937+0000 mgr.y (mgr.14150) 416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: audit 2024-09-15T03:27:53.081624+0000 mgr.y (mgr.14150) 417 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi104"}]: dispatch 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: cephadm 2024-09-15T03:27:53.100639+0000 mgr.y (mgr.14150) 418 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:27:55.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:54 smithi053 bash[21662]: cluster 2024-09-15T03:27:53.975942+0000 mon.a (mon.0) 1001 : cluster [DBG] mgrmap e16: y(active, since 10m), standbys: x 2024-09-15T03:27:55.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: cephadm 2024-09-15T03:27:52.946658+0000 mgr.y (mgr.14150) 412 : cephadm [INF] Checking pool "datapool" exists for service iscsi.datapool 2024-09-15T03:27:55.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: cephadm 2024-09-15T03:27:53.015009+0000 mgr.y (mgr.14150) 413 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:27:55.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: audit 2024-09-15T03:27:53.060910+0000 mgr.y (mgr.14150) 414 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-09-15T03:27:55.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: cephadm 2024-09-15T03:27:53.062640+0000 mgr.y (mgr.14150) 415 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.104:5000 to Dashboard 2024-09-15T03:27:55.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: audit 2024-09-15T03:27:53.063937+0000 mgr.y (mgr.14150) 416 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-09-15T03:27:55.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: audit 2024-09-15T03:27:53.081624+0000 mgr.y (mgr.14150) 417 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi104"}]: dispatch 2024-09-15T03:27:55.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: cephadm 2024-09-15T03:27:53.100639+0000 mgr.y (mgr.14150) 418 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:27:55.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:54 smithi104 bash[15781]: cluster 2024-09-15T03:27:53.975942+0000 mon.a (mon.0) 1001 : cluster [DBG] mgrmap e16: y(active, since 10m), standbys: x 2024-09-15T03:27:55.555 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:27:56.126 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:55 smithi104 bash[15781]: cluster 2024-09-15T03:27:54.723804+0000 mgr.y (mgr.14150) 419 : cluster [DBG] pgmap v391: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-15T03:27:56.126 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:55 smithi104 bash[39896]: log file path now is '/var/log/tcmu-runner.log' 2024-09-15T03:27:56.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:55 smithi053 bash[21662]: cluster 2024-09-15T03:27:54.723804+0000 mgr.y (mgr.14150) 419 : cluster [DBG] pgmap v391: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-15T03:27:56.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:55 smithi053 bash[15077]: cluster 2024-09-15T03:27:54.723804+0000 mgr.y (mgr.14150) 419 : cluster [DBG] pgmap v391: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 102 B/s wr, 0 op/s 2024-09-15T03:27:56.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: debug Started the configuration object watcher 2024-09-15T03:27:56.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: debug Checking for config object changes every 1s 2024-09-15T03:27:56.976 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: debug Processing osd blocklist entries for this node 2024-09-15T03:27:57.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: debug Reading the configuration object to update local LIO configuration 2024-09-15T03:27:57.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: debug Configuration does not have an entry for this host(smithi104.front.sepia.ceph.com) - nothing to define to LIO 2024-09-15T03:27:57.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: * Serving Flask app 'rbd-target-api' (lazy loading) 2024-09-15T03:27:57.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: * Environment: production 2024-09-15T03:27:57.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-15T03:27:57.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: Use a production WSGI server instead. 2024-09-15T03:27:57.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: * Debug mode: off 2024-09-15T03:27:57.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: debug * Running on all addresses. 2024-09-15T03:27:57.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-15T03:27:57.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: * Running on all addresses. 2024-09-15T03:27:57.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: WARNING: This is a development server. Do not use it in a production deployment. 2024-09-15T03:27:57.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: debug * Running on http://[fe80::ec4:7aff:fe8f:ce89]:5000/ (Press CTRL+C to quit) 2024-09-15T03:27:57.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:27:56 smithi104 bash[39933]: * Running on http://[fe80::ec4:7aff:fe8f:ce89]:5000/ (Press CTRL+C to quit) 2024-09-15T03:27:57.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:57 smithi053 bash[21662]: audit 2024-09-15T03:27:56.331802+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:57.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:57 smithi053 bash[21662]: cluster 2024-09-15T03:27:56.725217+0000 mgr.y (mgr.14150) 420 : cluster [DBG] pgmap v392: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:57.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:57 smithi053 bash[21662]: audit 2024-09-15T03:27:56.959999+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.104:0/2419299503' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T03:27:57.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:57 smithi053 bash[15077]: audit 2024-09-15T03:27:56.331802+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:57.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:57 smithi053 bash[15077]: cluster 2024-09-15T03:27:56.725217+0000 mgr.y (mgr.14150) 420 : cluster [DBG] pgmap v392: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:57.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:57 smithi053 bash[15077]: audit 2024-09-15T03:27:56.959999+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.104:0/2419299503' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T03:27:57.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:57 smithi104 bash[15781]: audit 2024-09-15T03:27:56.331802+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:27:57.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:57 smithi104 bash[15781]: cluster 2024-09-15T03:27:56.725217+0000 mgr.y (mgr.14150) 420 : cluster [DBG] pgmap v392: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:27:57.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:57 smithi104 bash[15781]: audit 2024-09-15T03:27:56.959999+0000 mon.b (mon.1) 27 : audit [DBG] from='client.? 172.21.15.104:0/2419299503' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T03:28:00.084 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:59 smithi104 bash[15781]: cluster 2024-09-15T03:27:58.726295+0000 mgr.y (mgr.14150) 421 : cluster [DBG] pgmap v393: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:00.084 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:27:59 smithi104 bash[15781]: audit 2024-09-15T03:27:58.791897+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:00.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:59 smithi053 bash[21662]: cluster 2024-09-15T03:27:58.726295+0000 mgr.y (mgr.14150) 421 : cluster [DBG] pgmap v393: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:00.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:27:59 smithi053 bash[21662]: audit 2024-09-15T03:27:58.791897+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:00.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:59 smithi053 bash[15077]: cluster 2024-09-15T03:27:58.726295+0000 mgr.y (mgr.14150) 421 : cluster [DBG] pgmap v393: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:00.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:27:59 smithi053 bash[15077]: audit 2024-09-15T03:27:58.791897+0000 mon.a (mon.0) 1003 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:01.405 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled prometheus update... 2024-09-15T03:28:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[15077]: cluster 2024-09-15T03:28:00.727216+0000 mgr.y (mgr.14150) 422 : cluster [DBG] pgmap v394: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[15077]: audit 2024-09-15T03:28:01.402689+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[15077]: audit 2024-09-15T03:28:01.403930+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[15077]: audit 2024-09-15T03:28:01.406829+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[15077]: audit 2024-09-15T03:28:01.407946+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:02.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[15077]: audit 2024-09-15T03:28:01.415406+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:02.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[21662]: cluster 2024-09-15T03:28:00.727216+0000 mgr.y (mgr.14150) 422 : cluster [DBG] pgmap v394: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[21662]: audit 2024-09-15T03:28:01.402689+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[21662]: audit 2024-09-15T03:28:01.403930+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[21662]: audit 2024-09-15T03:28:01.406829+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[21662]: audit 2024-09-15T03:28:01.407946+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:02.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:01 smithi053 bash[21662]: audit 2024-09-15T03:28:01.415406+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:02.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:01 smithi104 bash[15781]: cluster 2024-09-15T03:28:00.727216+0000 mgr.y (mgr.14150) 422 : cluster [DBG] pgmap v394: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:02.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:01 smithi104 bash[15781]: audit 2024-09-15T03:28:01.402689+0000 mon.a (mon.0) 1004 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:02.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:01 smithi104 bash[15781]: audit 2024-09-15T03:28:01.403930+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:02.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:01 smithi104 bash[15781]: audit 2024-09-15T03:28:01.406829+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:02.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:01 smithi104 bash[15781]: audit 2024-09-15T03:28:01.407946+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:02.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:01 smithi104 bash[15781]: audit 2024-09-15T03:28:01.415406+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:02.724 DEBUG:teuthology.orchestra.run.smithi104:prometheus.a> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@prometheus.a.service 2024-09-15T03:28:02.726 INFO:tasks.cephadm:Adding node-exporter.a on smithi053 2024-09-15T03:28:02.726 INFO:tasks.cephadm:Adding node-exporter.b on smithi104 2024-09-15T03:28:02.726 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply node-exporter '2;smithi053=a;smithi104=b' 2024-09-15T03:28:02.824 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:28:02.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:02 smithi104 bash[15781]: audit 2024-09-15T03:28:01.392663+0000 mgr.y (mgr.14150) 423 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi104=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:02.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:02 smithi104 bash[15781]: cephadm 2024-09-15T03:28:01.395662+0000 mgr.y (mgr.14150) 424 : cephadm [INF] Saving service prometheus spec with placement smithi104=a;count:1 2024-09-15T03:28:02.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:02 smithi104 bash[15781]: cephadm 2024-09-15T03:28:01.416089+0000 mgr.y (mgr.14150) 425 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:28:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:02 smithi053 bash[15077]: audit 2024-09-15T03:28:01.392663+0000 mgr.y (mgr.14150) 423 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi104=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:02 smithi053 bash[15077]: cephadm 2024-09-15T03:28:01.395662+0000 mgr.y (mgr.14150) 424 : cephadm [INF] Saving service prometheus spec with placement smithi104=a;count:1 2024-09-15T03:28:03.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:02 smithi053 bash[15077]: cephadm 2024-09-15T03:28:01.416089+0000 mgr.y (mgr.14150) 425 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:28:03.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:02 smithi053 bash[21662]: audit 2024-09-15T03:28:01.392663+0000 mgr.y (mgr.14150) 423 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi104=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:03.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:02 smithi053 bash[21662]: cephadm 2024-09-15T03:28:01.395662+0000 mgr.y (mgr.14150) 424 : cephadm [INF] Saving service prometheus spec with placement smithi104=a;count:1 2024-09-15T03:28:03.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:02 smithi053 bash[21662]: cephadm 2024-09-15T03:28:01.416089+0000 mgr.y (mgr.14150) 425 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:28:04.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: cluster 2024-09-15T03:28:02.728557+0000 mgr.y (mgr.14150) 426 : cluster [DBG] pgmap v395: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T03:28:04.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.365950+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.371592+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.374961+0000 mon.a (mon.0) 1011 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.379165+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.382135+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.383414+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.390518+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.443306+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.443752+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.444139+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[15077]: audit 2024-09-15T03:28:03.444505+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: cluster 2024-09-15T03:28:02.728557+0000 mgr.y (mgr.14150) 426 : cluster [DBG] pgmap v395: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T03:28:04.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.365950+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.371592+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.374961+0000 mon.a (mon.0) 1011 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.379165+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.382135+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.383414+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.390518+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.443306+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.443752+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-09-15T03:28:04.193 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.444139+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-09-15T03:28:04.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:03 smithi053 bash[21662]: audit 2024-09-15T03:28:03.444505+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-15T03:28:04.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: cluster 2024-09-15T03:28:02.728557+0000 mgr.y (mgr.14150) 426 : cluster [DBG] pgmap v395: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 426 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.365950+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.371592+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.374961+0000 mon.a (mon.0) 1011 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.379165+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.382135+0000 mon.a (mon.0) 1013 : audit [DBG] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.383414+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.390518+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.443306+0000 mon.a (mon.0) 1016 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-09-15T03:28:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.443752+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-09-15T03:28:04.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.444139+0000 mon.a (mon.0) 1018 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2024-09-15T03:28:04.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:03 smithi104 bash[15781]: audit 2024-09-15T03:28:03.444505+0000 mon.a (mon.0) 1019 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[15077]: cephadm 2024-09-15T03:28:03.436751+0000 mgr.y (mgr.14150) 427 : cephadm [INF] Deploying daemon prometheus.a on smithi104 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[15077]: audit 2024-09-15T03:28:04.394555+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[15077]: audit 2024-09-15T03:28:04.394670+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]': finished 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[15077]: audit 2024-09-15T03:28:04.394761+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]': finished 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[15077]: audit 2024-09-15T03:28:04.394837+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[15077]: cluster 2024-09-15T03:28:04.394924+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[21662]: cephadm 2024-09-15T03:28:03.436751+0000 mgr.y (mgr.14150) 427 : cephadm [INF] Deploying daemon prometheus.a on smithi104 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[21662]: audit 2024-09-15T03:28:04.394555+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-15T03:28:04.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[21662]: audit 2024-09-15T03:28:04.394670+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]': finished 2024-09-15T03:28:04.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[21662]: audit 2024-09-15T03:28:04.394761+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]': finished 2024-09-15T03:28:04.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[21662]: audit 2024-09-15T03:28:04.394837+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-15T03:28:04.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:04 smithi053 bash[21662]: cluster 2024-09-15T03:28:04.394924+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-15T03:28:05.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:04 smithi104 bash[15781]: cephadm 2024-09-15T03:28:03.436751+0000 mgr.y (mgr.14150) 427 : cephadm [INF] Deploying daemon prometheus.a on smithi104 2024-09-15T03:28:05.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:04 smithi104 bash[15781]: audit 2024-09-15T03:28:04.394555+0000 mon.a (mon.0) 1020 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2024-09-15T03:28:05.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:04 smithi104 bash[15781]: audit 2024-09-15T03:28:04.394670+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]': finished 2024-09-15T03:28:05.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:04 smithi104 bash[15781]: audit 2024-09-15T03:28:04.394761+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]': finished 2024-09-15T03:28:05.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:04 smithi104 bash[15781]: audit 2024-09-15T03:28:04.394837+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]': finished 2024-09-15T03:28:05.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:04 smithi104 bash[15781]: cluster 2024-09-15T03:28:04.394924+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2024-09-15T03:28:05.940 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:05 smithi053 bash[21662]: cluster 2024-09-15T03:28:04.729299+0000 mgr.y (mgr.14150) 428 : cluster [DBG] pgmap v397: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 102 B/s wr, 1 op/s 2024-09-15T03:28:05.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:05 smithi053 bash[21662]: cluster 2024-09-15T03:28:05.401814+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-15T03:28:05.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:05 smithi053 bash[15077]: cluster 2024-09-15T03:28:04.729299+0000 mgr.y (mgr.14150) 428 : cluster [DBG] pgmap v397: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 102 B/s wr, 1 op/s 2024-09-15T03:28:05.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:05 smithi053 bash[15077]: cluster 2024-09-15T03:28:05.401814+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-15T03:28:06.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:05 smithi104 bash[15781]: cluster 2024-09-15T03:28:04.729299+0000 mgr.y (mgr.14150) 428 : cluster [DBG] pgmap v397: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 102 B/s wr, 1 op/s 2024-09-15T03:28:06.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:05 smithi104 bash[15781]: cluster 2024-09-15T03:28:05.401814+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2024-09-15T03:28:06.984 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:28:06 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:28:07.251 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:28:08.134 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:07 smithi053 bash[21662]: audit 2024-09-15T03:28:06.698176+0000 mgr.y (mgr.14150) 429 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:08.134 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:07 smithi053 bash[21662]: cluster 2024-09-15T03:28:06.730212+0000 mgr.y (mgr.14150) 430 : cluster [DBG] pgmap v399: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:08.135 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:07 smithi053 bash[15077]: audit 2024-09-15T03:28:06.698176+0000 mgr.y (mgr.14150) 429 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:08.135 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:07 smithi053 bash[15077]: cluster 2024-09-15T03:28:06.730212+0000 mgr.y (mgr.14150) 430 : cluster [DBG] pgmap v399: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:08.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:07 smithi104 bash[15781]: audit 2024-09-15T03:28:06.698176+0000 mgr.y (mgr.14150) 429 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:08.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:07 smithi104 bash[15781]: cluster 2024-09-15T03:28:06.730212+0000 mgr.y (mgr.14150) 430 : cluster [DBG] pgmap v399: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:10.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:09 smithi053 bash[15077]: cluster 2024-09-15T03:28:08.731315+0000 mgr.y (mgr.14150) 431 : cluster [DBG] pgmap v400: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:10.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:09 smithi053 bash[21662]: cluster 2024-09-15T03:28:08.731315+0000 mgr.y (mgr.14150) 431 : cluster [DBG] pgmap v400: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:10.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:09 smithi104 bash[15781]: cluster 2024-09-15T03:28:08.731315+0000 mgr.y (mgr.14150) 431 : cluster [DBG] pgmap v400: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:11.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:11 smithi104 bash[15781]: audit 2024-09-15T03:28:10.553533+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:11 smithi104 bash[15781]: audit 2024-09-15T03:28:10.562995+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:11 smithi104 bash[15781]: audit 2024-09-15T03:28:10.570222+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:11 smithi104 bash[15781]: cluster 2024-09-15T03:28:10.732272+0000 mgr.y (mgr.14150) 432 : cluster [DBG] pgmap v401: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[15077]: audit 2024-09-15T03:28:10.553533+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[15077]: audit 2024-09-15T03:28:10.562995+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[15077]: audit 2024-09-15T03:28:10.570222+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[15077]: cluster 2024-09-15T03:28:10.732272+0000 mgr.y (mgr.14150) 432 : cluster [DBG] pgmap v401: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[21662]: audit 2024-09-15T03:28:10.553533+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[21662]: audit 2024-09-15T03:28:10.562995+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[21662]: audit 2024-09-15T03:28:10.570222+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:11.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:11 smithi053 bash[21662]: cluster 2024-09-15T03:28:10.732272+0000 mgr.y (mgr.14150) 432 : cluster [DBG] pgmap v401: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:14.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:13 smithi053 bash[15077]: cluster 2024-09-15T03:28:12.733650+0000 mgr.y (mgr.14150) 433 : cluster [DBG] pgmap v402: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:14.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:13 smithi053 bash[21662]: cluster 2024-09-15T03:28:12.733650+0000 mgr.y (mgr.14150) 433 : cluster [DBG] pgmap v402: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:14.199 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled node-exporter update... 2024-09-15T03:28:14.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:13 smithi104 bash[15781]: cluster 2024-09-15T03:28:12.733650+0000 mgr.y (mgr.14150) 433 : cluster [DBG] pgmap v402: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:15.334 DEBUG:teuthology.orchestra.run.smithi053:node-exporter.a> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@node-exporter.a.service 2024-09-15T03:28:15.336 DEBUG:teuthology.orchestra.run.smithi104:node-exporter.b> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@node-exporter.b.service 2024-09-15T03:28:15.339 INFO:tasks.cephadm:Adding alertmanager.a on smithi053 2024-09-15T03:28:15.339 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply alertmanager '1;smithi053=a' 2024-09-15T03:28:15.364 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:28:15.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:15 smithi104 bash[15781]: audit 2024-09-15T03:28:14.186801+0000 mgr.y (mgr.14150) 434 : audit [DBG] from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi053=a;smithi104=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:15.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:15 smithi104 bash[15781]: cephadm 2024-09-15T03:28:14.189884+0000 mgr.y (mgr.14150) 435 : cephadm [INF] Saving service node-exporter spec with placement smithi053=a;smithi104=b;count:2 2024-09-15T03:28:15.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:15 smithi104 bash[15781]: audit 2024-09-15T03:28:14.196707+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:15.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:15 smithi104 bash[15781]: cluster 2024-09-15T03:28:14.734576+0000 mgr.y (mgr.14150) 436 : cluster [DBG] pgmap v403: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:15.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[15077]: audit 2024-09-15T03:28:14.186801+0000 mgr.y (mgr.14150) 434 : audit [DBG] from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi053=a;smithi104=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:15.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[15077]: cephadm 2024-09-15T03:28:14.189884+0000 mgr.y (mgr.14150) 435 : cephadm [INF] Saving service node-exporter spec with placement smithi053=a;smithi104=b;count:2 2024-09-15T03:28:15.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[15077]: audit 2024-09-15T03:28:14.196707+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:15.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[15077]: cluster 2024-09-15T03:28:14.734576+0000 mgr.y (mgr.14150) 436 : cluster [DBG] pgmap v403: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:15.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[21662]: audit 2024-09-15T03:28:14.186801+0000 mgr.y (mgr.14150) 434 : audit [DBG] from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi053=a;smithi104=b", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:15.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[21662]: cephadm 2024-09-15T03:28:14.189884+0000 mgr.y (mgr.14150) 435 : cephadm [INF] Saving service node-exporter spec with placement smithi053=a;smithi104=b;count:2 2024-09-15T03:28:15.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[21662]: audit 2024-09-15T03:28:14.196707+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:15.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:15 smithi053 bash[21662]: cluster 2024-09-15T03:28:14.734576+0000 mgr.y (mgr.14150) 436 : cluster [DBG] pgmap v403: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:16.590 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:28:16.984 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:28:16 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:28:17.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:17 smithi104 bash[15781]: audit 2024-09-15T03:28:16.706620+0000 mgr.y (mgr.14150) 437 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:17.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:17 smithi104 bash[15781]: cluster 2024-09-15T03:28:16.735897+0000 mgr.y (mgr.14150) 438 : cluster [DBG] pgmap v404: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:18.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:17 smithi053 bash[15077]: audit 2024-09-15T03:28:16.706620+0000 mgr.y (mgr.14150) 437 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:18.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:17 smithi053 bash[15077]: cluster 2024-09-15T03:28:16.735897+0000 mgr.y (mgr.14150) 438 : cluster [DBG] pgmap v404: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:18.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:17 smithi053 bash[21662]: audit 2024-09-15T03:28:16.706620+0000 mgr.y (mgr.14150) 437 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:18.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:17 smithi053 bash[21662]: cluster 2024-09-15T03:28:16.735897+0000 mgr.y (mgr.14150) 438 : cluster [DBG] pgmap v404: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:19.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:19 smithi053 bash[15077]: audit 2024-09-15T03:28:18.570462+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:19.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:19 smithi053 bash[15077]: cluster 2024-09-15T03:28:18.736895+0000 mgr.y (mgr.14150) 439 : cluster [DBG] pgmap v405: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:19.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:19 smithi053 bash[21662]: audit 2024-09-15T03:28:18.570462+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:19.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:19 smithi053 bash[21662]: cluster 2024-09-15T03:28:18.736895+0000 mgr.y (mgr.14150) 439 : cluster [DBG] pgmap v405: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:19.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:19 smithi104 bash[15781]: audit 2024-09-15T03:28:18.570462+0000 mon.a (mon.0) 1030 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:19.949 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:19 smithi104 bash[15781]: cluster 2024-09-15T03:28:18.736895+0000 mgr.y (mgr.14150) 439 : cluster [DBG] pgmap v405: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:20.133 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:28:20.484 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:20 smithi104 systemd[1]: Started Ceph prometheus.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:28:21.436 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[17508]: ignoring --setuser ceph since I am not root 2024-09-15T03:28:21.436 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[17508]: ignoring --setgroup ceph since I am not root 2024-09-15T03:28:21.436 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[17508]: debug 2024-09-15T03:28:21.431+0000 7fe4e364cec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T03:28:21.437 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[15781]: audit 2024-09-15T03:28:20.241959+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.437 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[15781]: audit 2024-09-15T03:28:20.248163+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.437 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[15781]: audit 2024-09-15T03:28:20.253579+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.437 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[15781]: audit 2024-09-15T03:28:20.257688+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-15T03:28:21.437 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:21 smithi104 bash[15781]: cluster 2024-09-15T03:28:20.737780+0000 mgr.y (mgr.14150) 440 : cluster [DBG] pgmap v406: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:21.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15335]: ignoring --setuser ceph since I am not root 2024-09-15T03:28:21.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15335]: ignoring --setgroup ceph since I am not root 2024-09-15T03:28:21.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15335]: debug 2024-09-15T03:28:21.313+0000 7f7490504640 1 -- 172.21.15.53:0/1263999489 <== mon.2 v2:172.21.15.53:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fd836ba340 con 0x55fd836c7000 2024-09-15T03:28:21.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15335]: debug 2024-09-15T03:28:21.441+0000 7f7492d5eec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T03:28:21.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15077]: audit 2024-09-15T03:28:20.241959+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15077]: audit 2024-09-15T03:28:20.248163+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15077]: audit 2024-09-15T03:28:20.253579+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15077]: audit 2024-09-15T03:28:20.257688+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-15T03:28:21.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[15077]: cluster 2024-09-15T03:28:20.737780+0000 mgr.y (mgr.14150) 440 : cluster [DBG] pgmap v406: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:21.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[21662]: audit 2024-09-15T03:28:20.241959+0000 mon.a (mon.0) 1031 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[21662]: audit 2024-09-15T03:28:20.248163+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[21662]: audit 2024-09-15T03:28:20.253579+0000 mon.a (mon.0) 1033 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' 2024-09-15T03:28:21.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[21662]: audit 2024-09-15T03:28:20.257688+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-15T03:28:21.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:21 smithi053 bash[21662]: cluster 2024-09-15T03:28:20.737780+0000 mgr.y (mgr.14150) 440 : cluster [DBG] pgmap v406: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T03:28:22.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[15781]: audit 2024-09-15T03:28:21.267578+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-15T03:28:22.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[15781]: cluster 2024-09-15T03:28:21.267652+0000 mon.a (mon.0) 1036 : cluster [DBG] mgrmap e17: y(active, since 11m), standbys: x 2024-09-15T03:28:22.484 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[17508]: debug 2024-09-15T03:28:22.191+0000 7fe4e364cec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T03:28:22.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[17508]: debug 2024-09-15T03:28:22.259+0000 7fe4e364cec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T03:28:22.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[17508]: debug 2024-09-15T03:28:22.327+0000 7fe4e364cec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T03:28:22.544 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15335]: debug 2024-09-15T03:28:22.233+0000 7f7492d5eec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T03:28:22.545 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15335]: debug 2024-09-15T03:28:22.305+0000 7f7492d5eec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T03:28:22.545 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15335]: debug 2024-09-15T03:28:22.373+0000 7f7492d5eec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T03:28:22.545 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15077]: audit 2024-09-15T03:28:21.267578+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-15T03:28:22.545 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15077]: cluster 2024-09-15T03:28:21.267652+0000 mon.a (mon.0) 1036 : cluster [DBG] mgrmap e17: y(active, since 11m), standbys: x 2024-09-15T03:28:22.545 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[21662]: audit 2024-09-15T03:28:21.267578+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.14150 172.21.15.53:0/3931023036' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-15T03:28:22.545 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[21662]: cluster 2024-09-15T03:28:21.267652+0000 mon.a (mon.0) 1036 : cluster [DBG] mgrmap e17: y(active, since 11m), standbys: x 2024-09-15T03:28:22.756 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[17508]: debug 2024-09-15T03:28:22.483+0000 7fe4e364cec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:28:22.812 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15335]: debug 2024-09-15T03:28:22.537+0000 7f7492d5eec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:28:23.137 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[17508]: debug 2024-09-15T03:28:22.751+0000 7fe4e364cec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T03:28:23.137 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[17508]: debug 2024-09-15T03:28:22.815+0000 7fe4e364cec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T03:28:23.137 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:22 smithi104 bash[17508]: debug 2024-09-15T03:28:22.963+0000 7fe4e364cec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T03:28:23.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15335]: debug 2024-09-15T03:28:22.805+0000 7f7492d5eec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T03:28:23.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:22 smithi053 bash[15335]: debug 2024-09-15T03:28:22.869+0000 7f7492d5eec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T03:28:23.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:23 smithi053 bash[15335]: debug 2024-09-15T03:28:23.013+0000 7f7492d5eec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T03:28:23.734 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[17508]: debug 2024-09-15T03:28:23.635+0000 7fe4e364cec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T03:28:23.734 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[17508]: debug 2024-09-15T03:28:23.719+0000 7fe4e364cec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T03:28:23.734 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.575Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-15T03:28:23.734 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.575Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.575Z caller=main.go:570 level=info host_details="(Linux 5.15.0-121-generic #131~20.04.1-Ubuntu SMP Mon Aug 12 13:09:56 UTC 2024 x86_64 smithi104 (none))" 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.575Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.575Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.576Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.577Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.579Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.579Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.581Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.581Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.272µs 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.581Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.581Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-15T03:28:23.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.581Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=27.089µs wal_replay_duration=220.95µs wbl_replay_duration=139ns total_replay_duration=279.385µs 2024-09-15T03:28:23.736 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.583Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-15T03:28:23.736 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.583Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-15T03:28:23.736 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.583Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-15T03:28:23.736 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.602Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.476947ms db_storage=905ns remote_storage=1.406µs web_handler=446ns query_engine=727ns scrape=312.273µs scrape_sd=21.101µs notify=807ns notify_sd=1.903µs rules=18.847763ms tracing=5.533µs 2024-09-15T03:28:23.736 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.602Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-15T03:28:23.736 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[41532]: ts=2024-09-15T03:28:23.602Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-15T03:28:23.940 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:23 smithi053 bash[15335]: debug 2024-09-15T03:28:23.681+0000 7f7492d5eec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T03:28:23.940 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:23 smithi053 bash[15335]: debug 2024-09-15T03:28:23.757+0000 7f7492d5eec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T03:28:23.940 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:23 smithi053 bash[15335]: debug 2024-09-15T03:28:23.833+0000 7f7492d5eec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T03:28:24.123 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:23 smithi104 bash[17508]: debug 2024-09-15T03:28:23.803+0000 7fe4e364cec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T03:28:24.441 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:24 smithi053 bash[15335]: debug 2024-09-15T03:28:24.137+0000 7f7492d5eec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T03:28:24.441 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:24 smithi053 bash[15335]: debug 2024-09-15T03:28:24.281+0000 7f7492d5eec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T03:28:24.484 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:24 smithi104 bash[17508]: debug 2024-09-15T03:28:24.115+0000 7fe4e364cec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T03:28:25.240 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:24 smithi104 bash[17508]: debug 2024-09-15T03:28:24.271+0000 7fe4e364cec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T03:28:25.241 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:24 smithi053 bash[15335]: debug 2024-09-15T03:28:24.613+0000 7f7492d5eec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T03:28:25.241 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:24 smithi053 bash[15335]: debug 2024-09-15T03:28:24.837+0000 7f7492d5eec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:28:25.241 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:24 smithi104 bash[17508]: debug 2024-09-15T03:28:24.627+0000 7fe4e364cec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T03:28:25.241 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:24 smithi104 bash[17508]: debug 2024-09-15T03:28:24.863+0000 7fe4e364cec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T03:28:25.484 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.291+0000 7fe4e364cec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T03:28:25.484 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.355+0000 7fe4e364cec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T03:28:25.484 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.419+0000 7fe4e364cec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T03:28:25.544 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:25 smithi053 bash[15335]: debug 2024-09-15T03:28:25.305+0000 7f7492d5eec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T03:28:25.544 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:25 smithi053 bash[15335]: debug 2024-09-15T03:28:25.373+0000 7f7492d5eec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T03:28:25.544 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:25 smithi053 bash[15335]: debug 2024-09-15T03:28:25.441+0000 7f7492d5eec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T03:28:25.815 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.515+0000 7fe4e364cec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T03:28:25.816 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.583+0000 7fe4e364cec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T03:28:25.816 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.659+0000 7fe4e364cec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T03:28:25.844 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:25 smithi053 bash[15335]: debug 2024-09-15T03:28:25.537+0000 7f7492d5eec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T03:28:25.844 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:25 smithi053 bash[15335]: debug 2024-09-15T03:28:25.605+0000 7f7492d5eec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T03:28:25.845 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:25 smithi053 bash[15335]: debug 2024-09-15T03:28:25.689+0000 7f7492d5eec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T03:28:26.079 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.811+0000 7fe4e364cec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T03:28:26.079 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:25 smithi104 bash[17508]: debug 2024-09-15T03:28:25.887+0000 7fe4e364cec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T03:28:26.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:25 smithi053 bash[15335]: debug 2024-09-15T03:28:25.853+0000 7f7492d5eec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T03:28:26.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:26 smithi053 bash[15335]: debug 2024-09-15T03:28:25.929+0000 7f7492d5eec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T03:28:27.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:26 smithi053 bash[15335]: debug 2024-09-15T03:28:26.949+0000 7f7492d5eec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T03:28:27.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15335]: [15/Sep/2024:03:28:27] ENGINE Bus STARTING 2024-09-15T03:28:27.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15335]: CherryPy Checker: 2024-09-15T03:28:27.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15335]: The Application mounted at '' has an empty config. 2024-09-15T03:28:27.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: cluster 2024-09-15T03:28:26.975491+0000 mon.a (mon.0) 1037 : cluster [INF] Active manager daemon y restarted 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: cluster 2024-09-15T03:28:26.976258+0000 mon.a (mon.0) 1038 : cluster [INF] Activating manager daemon y 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: cluster 2024-09-15T03:28:26.987929+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: cluster 2024-09-15T03:28:26.988533+0000 mon.a (mon.0) 1040 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0124875s), standbys: x 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.990182+0000 mon.a (mon.0) 1041 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.990291+0000 mon.a (mon.0) 1042 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.990391+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.991816+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.992057+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.992335+0000 mon.a (mon.0) 1046 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:28:27.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.992642+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.992793+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.992950+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.993129+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.993324+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.993591+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.993793+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.993980+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T03:28:27.193 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.994101+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T03:28:27.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: cluster 2024-09-15T03:28:26.975491+0000 mon.a (mon.0) 1037 : cluster [INF] Active manager daemon y restarted 2024-09-15T03:28:27.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: cluster 2024-09-15T03:28:26.976258+0000 mon.a (mon.0) 1038 : cluster [INF] Activating manager daemon y 2024-09-15T03:28:27.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: cluster 2024-09-15T03:28:26.987929+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-15T03:28:27.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: cluster 2024-09-15T03:28:26.988533+0000 mon.a (mon.0) 1040 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0124875s), standbys: x 2024-09-15T03:28:27.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.990182+0000 mon.a (mon.0) 1041 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:28:27.194 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.990291+0000 mon.a (mon.0) 1042 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.990391+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.991816+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.992057+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.992335+0000 mon.a (mon.0) 1046 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.992642+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.992793+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.992950+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.993129+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.993324+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.993591+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:28:27.195 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.993793+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.993980+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.994101+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:26.994500+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: cluster 2024-09-15T03:28:27.008585+0000 mon.a (mon.0) 1057 : cluster [DBG] Standby manager daemon x restarted 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: cluster 2024-09-15T03:28:27.008745+0000 mon.a (mon.0) 1058 : cluster [DBG] Standby manager daemon x started 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:27.010737+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:27.012446+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:27.014773+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: audit 2024-09-15T03:28:27.016709+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[21662]: cluster 2024-09-15T03:28:27.020877+0000 mon.a (mon.0) 1059 : cluster [INF] Manager daemon y is now available 2024-09-15T03:28:27.196 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:26.994500+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T03:28:27.197 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: cluster 2024-09-15T03:28:27.008585+0000 mon.a (mon.0) 1057 : cluster [DBG] Standby manager daemon x restarted 2024-09-15T03:28:27.197 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: cluster 2024-09-15T03:28:27.008745+0000 mon.a (mon.0) 1058 : cluster [DBG] Standby manager daemon x started 2024-09-15T03:28:27.197 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:27.010737+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-15T03:28:27.197 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:27.012446+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T03:28:27.197 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:27.014773+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-15T03:28:27.197 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: audit 2024-09-15T03:28:27.016709+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T03:28:27.197 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15077]: cluster 2024-09-15T03:28:27.020877+0000 mon.a (mon.0) 1059 : cluster [INF] Manager daemon y is now available 2024-09-15T03:28:27.476 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:26 smithi104 bash[17508]: debug 2024-09-15T03:28:26.979+0000 7fe4e364cec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T03:28:27.476 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[17508]: [15/Sep/2024:03:28:27] ENGINE Bus STARTING 2024-09-15T03:28:27.476 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[17508]: CherryPy Checker: 2024-09-15T03:28:27.476 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[17508]: The Application mounted at '' has an empty config. 2024-09-15T03:28:27.477 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[17508]: [15/Sep/2024:03:28:27] ENGINE Serving on http://:::9283 2024-09-15T03:28:27.477 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[17508]: [15/Sep/2024:03:28:27] ENGINE Bus STARTED 2024-09-15T03:28:27.477 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: cluster 2024-09-15T03:28:26.975491+0000 mon.a (mon.0) 1037 : cluster [INF] Active manager daemon y restarted 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: cluster 2024-09-15T03:28:26.976258+0000 mon.a (mon.0) 1038 : cluster [INF] Activating manager daemon y 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: cluster 2024-09-15T03:28:26.987929+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: cluster 2024-09-15T03:28:26.988533+0000 mon.a (mon.0) 1040 : cluster [DBG] mgrmap e18: y(active, starting, since 0.0124875s), standbys: x 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.990182+0000 mon.a (mon.0) 1041 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.990291+0000 mon.a (mon.0) 1042 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.990391+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.991816+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.992057+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.992335+0000 mon.a (mon.0) 1046 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.992642+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.992793+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T03:28:27.478 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.992950+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.993129+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.993324+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.993591+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.993793+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.993980+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.994101+0000 mon.a (mon.0) 1055 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:26.994500+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: cluster 2024-09-15T03:28:27.008585+0000 mon.a (mon.0) 1057 : cluster [DBG] Standby manager daemon x restarted 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: cluster 2024-09-15T03:28:27.008745+0000 mon.a (mon.0) 1058 : cluster [DBG] Standby manager daemon x started 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:27.010737+0000 mon.b (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-15T03:28:27.479 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:27.012446+0000 mon.b (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T03:28:27.480 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:27.014773+0000 mon.b (mon.1) 30 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-15T03:28:27.480 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: audit 2024-09-15T03:28:27.016709+0000 mon.b (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.104:0/215245499' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T03:28:27.480 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:27 smithi104 bash[15781]: cluster 2024-09-15T03:28:27.020877+0000 mon.a (mon.0) 1059 : cluster [INF] Manager daemon y is now available 2024-09-15T03:28:27.523 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15335]: [15/Sep/2024:03:28:27] ENGINE Serving on http://:::9283 2024-09-15T03:28:27.523 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:27 smithi053 bash[15335]: [15/Sep/2024:03:28:27] ENGINE Bus STARTED 2024-09-15T03:28:28.012 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled alertmanager update... 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.054031+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.057156+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.062683+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.069451+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]': finished 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.069651+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.074880+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]': finished 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.079843+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.082817+0000 mon.a (mon.0) 1067 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.084493+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: cephadm 2024-09-15T03:28:27.086713+0000 mgr.y (mgr.24494) 1 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:28:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.086790+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: cephadm 2024-09-15T03:28:27.095831+0000 mgr.y (mgr.24494) 2 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.099638+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:27.143192+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: cluster 2024-09-15T03:28:27.997936+0000 mon.a (mon.0) 1072 : cluster [DBG] mgrmap e19: y(active, since 1.02189s), standbys: x 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[21662]: audit 2024-09-15T03:28:28.010479+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.054031+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.057156+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.062683+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.069451+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]': finished 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.069651+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:28:28.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.074880+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]': finished 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.079843+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.082817+0000 mon.a (mon.0) 1067 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.084493+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: cephadm 2024-09-15T03:28:27.086713+0000 mgr.y (mgr.24494) 1 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.086790+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: cephadm 2024-09-15T03:28:27.095831+0000 mgr.y (mgr.24494) 2 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.099638+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:27.143192+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: cluster 2024-09-15T03:28:27.997936+0000 mon.a (mon.0) 1072 : cluster [DBG] mgrmap e19: y(active, since 1.02189s), standbys: x 2024-09-15T03:28:28.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15077]: audit 2024-09-15T03:28:28.010479+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.484 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.054031+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.057156+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.062683+0000 mon.a (mon.0) 1062 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.069451+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]': finished 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.069651+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]: dispatch 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.074880+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi104", "name": "osd_memory_target"}]': finished 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.079843+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.082817+0000 mon.a (mon.0) 1067 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.084493+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: cephadm 2024-09-15T03:28:27.086713+0000 mgr.y (mgr.24494) 1 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.conf 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.086790+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: cephadm 2024-09-15T03:28:27.095831+0000 mgr.y (mgr.24494) 2 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.conf 2024-09-15T03:28:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.099638+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-15T03:28:28.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:27.143192+0000 mon.a (mon.0) 1071 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-15T03:28:28.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: cluster 2024-09-15T03:28:27.997936+0000 mon.a (mon.0) 1072 : cluster [DBG] mgrmap e19: y(active, since 1.02189s), standbys: x 2024-09-15T03:28:28.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:28 smithi104 bash[15781]: audit 2024-09-15T03:28:28.010479+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:28.892 DEBUG:teuthology.orchestra.run.smithi053:alertmanager.a> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@alertmanager.a.service 2024-09-15T03:28:28.894 INFO:tasks.cephadm:Adding grafana.a on smithi104 2024-09-15T03:28:28.895 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph orch apply grafana '1;smithi104=a' 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: debug 2024-09-15T03:28:28.737+0000 7f7435ad4640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:03:28:28] ENGINE Error in HTTPServer.serve 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: Traceback (most recent call last): 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: self._connections.run(self.expiration_interval) 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: self._run(expiration_interval) 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:28:29.020 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: s = self.context.wrap_socket( 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: return self.sslsocket_class._create( 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: self.do_handshake() 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: self._sslobj.do_handshake() 2024-09-15T03:28:29.021 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:28:28 smithi053 bash[15335]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:28:29.028 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:28:29.298 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:27.765859+0000 mgr.y (mgr.24494) 3 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:27.788772+0000 mgr.y (mgr.24494) 4 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:27.903613+0000 mgr.y (mgr.24494) 5 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:27.935182+0000 mgr.y (mgr.24494) 6 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.002616+0000 mgr.y (mgr.24494) 7 : audit [DBG] from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi053=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.003697+0000 mgr.y (mgr.24494) 8 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cluster 2024-09-15T03:28:28.005318+0000 mgr.y (mgr.24494) 9 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.005498+0000 mgr.y (mgr.24494) 10 : cephadm [INF] Saving service alertmanager spec with placement smithi053=a;count:1 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.046948+0000 mgr.y (mgr.24494) 11 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.097859+0000 mgr.y (mgr.24494) 12 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.183414+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.189694+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.299 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.237945+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.243418+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.247638+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.251751+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.254673+0000 mgr.y (mgr.24494) 13 : cephadm [INF] Deploying daemon node-exporter.a on smithi053 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[21662]: audit 2024-09-15T03:28:28.747299+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:27.765859+0000 mgr.y (mgr.24494) 3 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:27.788772+0000 mgr.y (mgr.24494) 4 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:27.903613+0000 mgr.y (mgr.24494) 5 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:27.935182+0000 mgr.y (mgr.24494) 6 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.002616+0000 mgr.y (mgr.24494) 7 : audit [DBG] from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi053=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:29.300 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.003697+0000 mgr.y (mgr.24494) 8 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cluster 2024-09-15T03:28:28.005318+0000 mgr.y (mgr.24494) 9 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.005498+0000 mgr.y (mgr.24494) 10 : cephadm [INF] Saving service alertmanager spec with placement smithi053=a;count:1 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.046948+0000 mgr.y (mgr.24494) 11 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.097859+0000 mgr.y (mgr.24494) 12 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.183414+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.189694+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.237945+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.243418+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.247638+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.251751+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.254673+0000 mgr.y (mgr.24494) 13 : cephadm [INF] Deploying daemon node-exporter.a on smithi053 2024-09-15T03:28:29.301 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[15077]: audit 2024-09-15T03:28:28.747299+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:27.765859+0000 mgr.y (mgr.24494) 3 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:28:29.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:27.788772+0000 mgr.y (mgr.24494) 4 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T03:28:29.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:27.903613+0000 mgr.y (mgr.24494) 5 : cephadm [INF] Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:27.935182+0000 mgr.y (mgr.24494) 6 : cephadm [INF] Updating smithi104:/etc/ceph/ceph.client.admin.keyring 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.002616+0000 mgr.y (mgr.24494) 7 : audit [DBG] from='client.24517 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi053=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.003697+0000 mgr.y (mgr.24494) 8 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cluster 2024-09-15T03:28:28.005318+0000 mgr.y (mgr.24494) 9 : cluster [DBG] pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.005498+0000 mgr.y (mgr.24494) 10 : cephadm [INF] Saving service alertmanager spec with placement smithi053=a;count:1 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.046948+0000 mgr.y (mgr.24494) 11 : cephadm [INF] Updating smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.097859+0000 mgr.y (mgr.24494) 12 : cephadm [INF] Updating smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.183414+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.189694+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.237945+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.243418+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.247638+0000 mon.a (mon.0) 1078 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.487 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.251751+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.488 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.254673+0000 mgr.y (mgr.24494) 13 : cephadm [INF] Deploying daemon node-exporter.a on smithi053 2024-09-15T03:28:29.488 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:29 smithi104 bash[15781]: audit 2024-09-15T03:28:28.747299+0000 mon.a (mon.0) 1080 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:29.558 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:29 smithi053 bash[47728]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-09-15T03:28:30.305 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: v1.5.0: Pulling from prometheus/node-exporter 2024-09-15T03:28:30.305 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.613268+0000 mgr.y (mgr.24494) 14 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Bus STARTING 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.741163+0000 mgr.y (mgr.24494) 15 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Serving on https://172.21.15.53:7150 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.741354+0000 mgr.y (mgr.24494) 16 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Bus STARTED 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: cephadm 2024-09-15T03:28:28.744151+0000 mgr.y (mgr.24494) 17 : cephadm [ERR] [15/Sep/2024:03:28:28] ENGINE Error in HTTPServer.serve 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: Traceback (most recent call last): 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: self._connections.run(self.expiration_interval) 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: self._run(expiration_interval) 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:28:30.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: s = self.context.wrap_socket( 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: return self.sslsocket_class._create( 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: self.do_handshake() 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: self._sslobj.do_handshake() 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: cluster 2024-09-15T03:28:28.993610+0000 mgr.y (mgr.24494) 18 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: audit 2024-09-15T03:28:29.453142+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: audit 2024-09-15T03:28:29.459593+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.307 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: audit 2024-09-15T03:28:29.466032+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[21662]: cluster 2024-09-15T03:28:30.005737+0000 mon.a (mon.0) 1084 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.613268+0000 mgr.y (mgr.24494) 14 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Bus STARTING 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.741163+0000 mgr.y (mgr.24494) 15 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Serving on https://172.21.15.53:7150 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.741354+0000 mgr.y (mgr.24494) 16 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Bus STARTED 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: cephadm 2024-09-15T03:28:28.744151+0000 mgr.y (mgr.24494) 17 : cephadm [ERR] [15/Sep/2024:03:28:28] ENGINE Error in HTTPServer.serve 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: Traceback (most recent call last): 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: self._connections.run(self.expiration_interval) 2024-09-15T03:28:30.308 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: self._run(expiration_interval) 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: s = self.context.wrap_socket( 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: return self.sslsocket_class._create( 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: self.do_handshake() 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: self._sslobj.do_handshake() 2024-09-15T03:28:30.309 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:28:30.310 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: cluster 2024-09-15T03:28:28.993610+0000 mgr.y (mgr.24494) 18 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:30.310 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: audit 2024-09-15T03:28:29.453142+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.310 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: audit 2024-09-15T03:28:29.459593+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.310 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: audit 2024-09-15T03:28:29.466032+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.310 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[15077]: cluster 2024-09-15T03:28:30.005737+0000 mon.a (mon.0) 1084 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-15T03:28:30.311 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:30 smithi104 systemd[1]: Started Ceph node-exporter.b for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.613268+0000 mgr.y (mgr.24494) 14 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Bus STARTING 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.741163+0000 mgr.y (mgr.24494) 15 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Serving on https://172.21.15.53:7150 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.741354+0000 mgr.y (mgr.24494) 16 : cephadm [INF] [15/Sep/2024:03:28:28] ENGINE Bus STARTED 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: cephadm 2024-09-15T03:28:28.744151+0000 mgr.y (mgr.24494) 17 : cephadm [ERR] [15/Sep/2024:03:28:28] ENGINE Error in HTTPServer.serve 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: Traceback (most recent call last): 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: self._connections.run(self.expiration_interval) 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: self._run(expiration_interval) 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T03:28:30.312 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: s = self.context.wrap_socket( 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: return self.sslsocket_class._create( 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: self.do_handshake() 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: self._sslobj.do_handshake() 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: cluster 2024-09-15T03:28:28.993610+0000 mgr.y (mgr.24494) 18 : cluster [DBG] pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: audit 2024-09-15T03:28:29.453142+0000 mon.a (mon.0) 1081 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: audit 2024-09-15T03:28:29.459593+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.313 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: audit 2024-09-15T03:28:29.466032+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:30.314 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[15781]: cluster 2024-09-15T03:28:30.005737+0000 mon.a (mon.0) 1084 : cluster [DBG] mgrmap e20: y(active, since 3s), standbys: x 2024-09-15T03:28:30.586 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: 22b70bddd3ac: Pulling fs layer 2024-09-15T03:28:30.586 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: 5c12815fee55: Pulling fs layer 2024-09-15T03:28:30.586 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: c0e87333d380: Pulling fs layer 2024-09-15T03:28:30.586 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: 22b70bddd3ac: Download complete 2024-09-15T03:28:30.586 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: 5c12815fee55: Verifying Checksum 2024-09-15T03:28:30.586 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: 5c12815fee55: Download complete 2024-09-15T03:28:30.734 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[42541]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-09-15T03:28:30.940 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: c0e87333d380: Verifying Checksum 2024-09-15T03:28:30.940 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: c0e87333d380: Download complete 2024-09-15T03:28:30.941 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:30 smithi053 bash[47728]: 22b70bddd3ac: Pull complete 2024-09-15T03:28:31.234 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:30 smithi104 bash[42541]: v1.5.0: Pulling from prometheus/node-exporter 2024-09-15T03:28:31.234 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: 22b70bddd3ac: Pulling fs layer 2024-09-15T03:28:31.234 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: 5c12815fee55: Pulling fs layer 2024-09-15T03:28:31.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: c0e87333d380: Pulling fs layer 2024-09-15T03:28:31.690 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[47728]: 5c12815fee55: Pull complete 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: cephadm 2024-09-15T03:28:29.467350+0000 mgr.y (mgr.24494) 19 : cephadm [INF] Deploying daemon node-exporter.b on smithi104 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.294009+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.300255+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.306546+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.311581+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.323942+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.755488+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.761759+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[21662]: audit 2024-09-15T03:28:30.768428+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: cephadm 2024-09-15T03:28:29.467350+0000 mgr.y (mgr.24494) 19 : cephadm [INF] Deploying daemon node-exporter.b on smithi104 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.294009+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.300255+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.306546+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.311581+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.323942+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.755488+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.761759+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:31 smithi053 bash[15077]: audit 2024-09-15T03:28:30.768428+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.734 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: 22b70bddd3ac: Verifying Checksum 2024-09-15T03:28:31.734 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: 22b70bddd3ac: Download complete 2024-09-15T03:28:31.734 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: 5c12815fee55: Verifying Checksum 2024-09-15T03:28:31.734 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: 5c12815fee55: Download complete 2024-09-15T03:28:31.735 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: c0e87333d380: Verifying Checksum 2024-09-15T03:28:31.735 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: c0e87333d380: Download complete 2024-09-15T03:28:31.735 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[42541]: 22b70bddd3ac: Pull complete 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: cephadm 2024-09-15T03:28:29.467350+0000 mgr.y (mgr.24494) 19 : cephadm [INF] Deploying daemon node-exporter.b on smithi104 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.294009+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.300255+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.306546+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.311581+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.323942+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.755488+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.761759+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:31.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:31 smithi104 bash[15781]: audit 2024-09-15T03:28:30.768428+0000 mon.a (mon.0) 1092 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:32.441 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[47728]: c0e87333d380: Pull complete 2024-09-15T03:28:32.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[21662]: cephadm 2024-09-15T03:28:30.338423+0000 mgr.y (mgr.24494) 20 : cephadm [INF] Deploying daemon alertmanager.a on smithi053 2024-09-15T03:28:32.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[21662]: cluster 2024-09-15T03:28:30.993990+0000 mgr.y (mgr.24494) 21 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:32.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[21662]: cluster 2024-09-15T03:28:31.780480+0000 mon.a (mon.0) 1093 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-15T03:28:32.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[21662]: audit 2024-09-15T03:28:32.077821+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:32.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[15077]: cephadm 2024-09-15T03:28:30.338423+0000 mgr.y (mgr.24494) 20 : cephadm [INF] Deploying daemon alertmanager.a on smithi053 2024-09-15T03:28:32.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[15077]: cluster 2024-09-15T03:28:30.993990+0000 mgr.y (mgr.24494) 21 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:32.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[15077]: cluster 2024-09-15T03:28:31.780480+0000 mon.a (mon.0) 1093 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-15T03:28:32.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:32 smithi053 bash[15077]: audit 2024-09-15T03:28:32.077821+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:32.484 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:32 smithi104 bash[42541]: 5c12815fee55: Pull complete 2024-09-15T03:28:32.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:32 smithi104 bash[15781]: cephadm 2024-09-15T03:28:30.338423+0000 mgr.y (mgr.24494) 20 : cephadm [INF] Deploying daemon alertmanager.a on smithi053 2024-09-15T03:28:32.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:32 smithi104 bash[15781]: cluster 2024-09-15T03:28:30.993990+0000 mgr.y (mgr.24494) 21 : cluster [DBG] pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-09-15T03:28:32.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:32 smithi104 bash[15781]: cluster 2024-09-15T03:28:31.780480+0000 mon.a (mon.0) 1093 : cluster [DBG] mgrmap e21: y(active, since 4s), standbys: x 2024-09-15T03:28:32.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:32 smithi104 bash[15781]: audit 2024-09-15T03:28:32.077821+0000 mon.a (mon.0) 1094 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:33.666 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:28:33.681 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:33 smithi053 bash[47728]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-09-15T03:28:33.681 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:33 smithi053 bash[47728]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-09-15T03:28:33.734 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:33 smithi104 bash[42541]: c0e87333d380: Pull complete 2024-09-15T03:28:34.193 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:33 smithi104 bash[42541]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-09-15T03:28:34.193 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:34 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:28:34] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:28:34.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:34 smithi104 bash[42541]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-09-15T03:28:34.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:34 smithi104 bash[15781]: cluster 2024-09-15T03:28:32.994441+0000 mgr.y (mgr.24494) 22 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-15T03:28:34.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:34 smithi104 bash[15781]: audit 2024-09-15T03:28:34.188922+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:34.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:34 smithi053 bash[21662]: cluster 2024-09-15T03:28:32.994441+0000 mgr.y (mgr.24494) 22 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-15T03:28:34.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:34 smithi053 bash[21662]: audit 2024-09-15T03:28:34.188922+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:34.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:34 smithi053 bash[15077]: cluster 2024-09-15T03:28:32.994441+0000 mgr.y (mgr.24494) 22 : cluster [DBG] pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-09-15T03:28:34.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:34 smithi053 bash[15077]: audit 2024-09-15T03:28:34.188922+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:36.191 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.834Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-15T03:28:36.191 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.834Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-15T03:28:36.191 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.834Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-15T03:28:36.191 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.835Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-15T03:28:36.191 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.835Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-15T03:28:36.191 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.835Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=arp 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=edac 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-15T03:28:36.192 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-15T03:28:36.193 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=os 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=stat 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-15T03:28:36.194 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=time 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=uname 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-15T03:28:36.195 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:28:35 smithi053 bash[47728]: ts=2024-09-15T03:28:35.836Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-15T03:28:36.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:36 smithi053 bash[21662]: cluster 2024-09-15T03:28:34.995773+0000 mgr.y (mgr.24494) 23 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-15T03:28:36.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:36 smithi053 bash[15077]: cluster 2024-09-15T03:28:34.995773+0000 mgr.y (mgr.24494) 23 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-15T03:28:36.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:36 smithi104 bash[15781]: cluster 2024-09-15T03:28:34.995773+0000 mgr.y (mgr.24494) 23 : cluster [DBG] pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 26 KiB/s rd, 0 B/s wr, 11 op/s 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.033Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.033Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.033Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.033Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=arp 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-15T03:28:37.235 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.034Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=edac 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-15T03:28:37.236 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-15T03:28:37.237 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=os 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=stat 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-15T03:28:37.238 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=time 2024-09-15T03:28:37.239 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-15T03:28:37.239 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=uname 2024-09-15T03:28:37.239 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-15T03:28:37.239 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-15T03:28:37.239 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-15T03:28:37.239 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-15T03:28:37.239 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:28:37 smithi104 bash[42541]: ts=2024-09-15T03:28:37.035Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-15T03:28:38.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:28:38 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:28:38.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:38 smithi053 bash[21662]: cluster 2024-09-15T03:28:36.996549+0000 mgr.y (mgr.24494) 24 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-15T03:28:38.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:38 smithi053 bash[15077]: cluster 2024-09-15T03:28:36.996549+0000 mgr.y (mgr.24494) 24 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-15T03:28:38.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:38 smithi104 bash[15781]: cluster 2024-09-15T03:28:36.996549+0000 mgr.y (mgr.24494) 24 : cluster [DBG] pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-15T03:28:39.530 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:39 smithi053 bash[21662]: audit 2024-09-15T03:28:38.014645+0000 mgr.y (mgr.24494) 25 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:39.530 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:39 smithi053 bash[15077]: audit 2024-09-15T03:28:38.014645+0000 mgr.y (mgr.24494) 25 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:39.734 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:39 smithi104 bash[15781]: audit 2024-09-15T03:28:38.014645+0000 mgr.y (mgr.24494) 25 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:40.410 INFO:teuthology.orchestra.run.smithi104.stdout:Scheduled grafana update... 2024-09-15T03:28:40.430 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:40 smithi053 bash[15077]: cluster 2024-09-15T03:28:38.997934+0000 mgr.y (mgr.24494) 26 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-15T03:28:40.431 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:40 smithi053 bash[21662]: cluster 2024-09-15T03:28:38.997934+0000 mgr.y (mgr.24494) 26 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-15T03:28:40.592 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:40 smithi104 bash[15781]: cluster 2024-09-15T03:28:38.997934+0000 mgr.y (mgr.24494) 26 : cluster [DBG] pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-15T03:28:41.313 DEBUG:teuthology.orchestra.run.smithi104:grafana.a> sudo journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@grafana.a.service 2024-09-15T03:28:41.315 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T03:28:41.316 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T03:28:41.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:41 smithi104 bash[15781]: audit 2024-09-15T03:28:40.399649+0000 mgr.y (mgr.24494) 27 : audit [DBG] from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi104=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:41.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:41 smithi104 bash[15781]: cephadm 2024-09-15T03:28:40.401424+0000 mgr.y (mgr.24494) 28 : cephadm [INF] Saving service grafana spec with placement smithi104=a;count:1 2024-09-15T03:28:41.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:41 smithi104 bash[15781]: audit 2024-09-15T03:28:40.407820+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:41 smithi104 bash[15781]: audit 2024-09-15T03:28:40.822063+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:41 smithi104 bash[15781]: audit 2024-09-15T03:28:40.828731+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:41 smithi104 bash[15781]: audit 2024-09-15T03:28:40.835502+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:41 smithi104 bash[15781]: cluster 2024-09-15T03:28:40.998430+0000 mgr.y (mgr.24494) 29 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[21662]: audit 2024-09-15T03:28:40.399649+0000 mgr.y (mgr.24494) 27 : audit [DBG] from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi104=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[21662]: cephadm 2024-09-15T03:28:40.401424+0000 mgr.y (mgr.24494) 28 : cephadm [INF] Saving service grafana spec with placement smithi104=a;count:1 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[21662]: audit 2024-09-15T03:28:40.407820+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[21662]: audit 2024-09-15T03:28:40.822063+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[21662]: audit 2024-09-15T03:28:40.828731+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[21662]: audit 2024-09-15T03:28:40.835502+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[21662]: cluster 2024-09-15T03:28:40.998430+0000 mgr.y (mgr.24494) 29 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-15T03:28:41.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[15077]: audit 2024-09-15T03:28:40.399649+0000 mgr.y (mgr.24494) 27 : audit [DBG] from='client.24541 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi104=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:28:41.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[15077]: cephadm 2024-09-15T03:28:40.401424+0000 mgr.y (mgr.24494) 28 : cephadm [INF] Saving service grafana spec with placement smithi104=a;count:1 2024-09-15T03:28:41.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[15077]: audit 2024-09-15T03:28:40.407820+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[15077]: audit 2024-09-15T03:28:40.822063+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[15077]: audit 2024-09-15T03:28:40.828731+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[15077]: audit 2024-09-15T03:28:40.835502+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:41.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:41 smithi053 bash[15077]: cluster 2024-09-15T03:28:40.998430+0000 mgr.y (mgr.24494) 29 : cluster [DBG] pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-15T03:28:41.846 INFO:journalctl@ceph.grafana.a.smithi104.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2024-09-15T03:28:42.786 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:42 smithi053 systemd[1]: Started Ceph alertmanager.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:28:43.041 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.035979+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.041 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.042813+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.041 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.050309+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.041 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.085218+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:43.041 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.511396+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.419 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.035979+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.042813+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.050309+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.085218+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.511396+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.518602+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.524448+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.529906+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.570686+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.573028+0000 mon.a (mon.0) 1109 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.573942+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:43.420 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[21662]: audit 2024-09-15T03:28:42.580797+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.518602+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.524448+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.529906+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.570686+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:43.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.573028+0000 mon.a (mon.0) 1109 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:43.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.573942+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:43.421 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:43 smithi053 bash[15077]: audit 2024-09-15T03:28:42.580797+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.035979+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.042813+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.050309+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.085218+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.511396+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.518602+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.524448+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.529906+0000 mon.a (mon.0) 1107 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.570686+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.573028+0000 mon.a (mon.0) 1109 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:28:43.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.573942+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:28:43.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:43 smithi104 bash[15781]: audit 2024-09-15T03:28:42.580797+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[15077]: cephadm 2024-09-15T03:28:42.581388+0000 mgr.y (mgr.24494) 30 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:28:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[15077]: cephadm 2024-09-15T03:28:42.621489+0000 mgr.y (mgr.24494) 31 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-15T03:28:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[15077]: cephadm 2024-09-15T03:28:42.626954+0000 mgr.y (mgr.24494) 32 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi053 2024-09-15T03:28:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[15077]: cluster 2024-09-15T03:28:42.998946+0000 mgr.y (mgr.24494) 33 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-15T03:28:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[15077]: audit 2024-09-15T03:28:43.405215+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[15077]: audit 2024-09-15T03:28:43.411086+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[15077]: audit 2024-09-15T03:28:43.416684+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[21662]: cephadm 2024-09-15T03:28:42.581388+0000 mgr.y (mgr.24494) 30 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:28:44.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[21662]: cephadm 2024-09-15T03:28:42.621489+0000 mgr.y (mgr.24494) 31 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-15T03:28:44.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[21662]: cephadm 2024-09-15T03:28:42.626954+0000 mgr.y (mgr.24494) 32 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi053 2024-09-15T03:28:44.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[21662]: cluster 2024-09-15T03:28:42.998946+0000 mgr.y (mgr.24494) 33 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-15T03:28:44.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[21662]: audit 2024-09-15T03:28:43.405215+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[21662]: audit 2024-09-15T03:28:43.411086+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[21662]: audit 2024-09-15T03:28:43.416684+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.484 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:28:44] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:28:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[15781]: cephadm 2024-09-15T03:28:42.581388+0000 mgr.y (mgr.24494) 30 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:28:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[15781]: cephadm 2024-09-15T03:28:42.621489+0000 mgr.y (mgr.24494) 31 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-09-15T03:28:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[15781]: cephadm 2024-09-15T03:28:42.626954+0000 mgr.y (mgr.24494) 32 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi053 2024-09-15T03:28:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[15781]: cluster 2024-09-15T03:28:42.998946+0000 mgr.y (mgr.24494) 33 : cluster [DBG] pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-15T03:28:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[15781]: audit 2024-09-15T03:28:43.405215+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[15781]: audit 2024-09-15T03:28:43.411086+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:44 smithi104 bash[15781]: audit 2024-09-15T03:28:43.416684+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.622Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.622Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.624Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.53 port=9094 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.625Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.667Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.667Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.672Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-15T03:28:44.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:44 smithi053 bash[48597]: ts=2024-09-15T03:28:44.672Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-15T03:28:46.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:46 smithi053 bash[15077]: cluster 2024-09-15T03:28:45.000268+0000 mgr.y (mgr.24494) 34 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-15T03:28:46.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:46 smithi053 bash[21662]: cluster 2024-09-15T03:28:45.000268+0000 mgr.y (mgr.24494) 34 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-15T03:28:46.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:46 smithi104 bash[15781]: cluster 2024-09-15T03:28:45.000268+0000 mgr.y (mgr.24494) 34 : cluster [DBG] pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-15T03:28:46.895 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:28:46.940 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:46 smithi053 bash[48597]: ts=2024-09-15T03:28:46.625Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000241948s 2024-09-15T03:28:47.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:47 smithi053 bash[21662]: audit 2024-09-15T03:28:46.602719+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:47.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:47 smithi053 bash[21662]: cluster 2024-09-15T03:28:47.000974+0000 mgr.y (mgr.24494) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:47.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:47 smithi053 bash[21662]: audit 2024-09-15T03:28:47.086979+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:47.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:47 smithi053 bash[15077]: audit 2024-09-15T03:28:46.602719+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:47.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:47 smithi053 bash[15077]: cluster 2024-09-15T03:28:47.000974+0000 mgr.y (mgr.24494) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:47.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:47 smithi053 bash[15077]: audit 2024-09-15T03:28:47.086979+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:47.935 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:47 smithi104 bash[15781]: audit 2024-09-15T03:28:46.602719+0000 mon.a (mon.0) 1115 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:47.935 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:47 smithi104 bash[15781]: cluster 2024-09-15T03:28:47.000974+0000 mgr.y (mgr.24494) 35 : cluster [DBG] pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:47.935 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:47 smithi104 bash[15781]: audit 2024-09-15T03:28:47.086979+0000 mon.a (mon.0) 1116 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:48.234 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:28:48 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:28:48.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:48 smithi053 bash[21662]: audit 2024-09-15T03:28:48.025862+0000 mgr.y (mgr.24494) 36 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:48.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:48 smithi053 bash[15077]: audit 2024-09-15T03:28:48.025862+0000 mgr.y (mgr.24494) 36 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:48.984 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:48 smithi104 bash[15781]: audit 2024-09-15T03:28:48.025862+0000 mgr.y (mgr.24494) 36 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:49.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:49 smithi053 bash[15077]: cluster 2024-09-15T03:28:49.002190+0000 mgr.y (mgr.24494) 37 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:28:49.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:49 smithi053 bash[21662]: cluster 2024-09-15T03:28:49.002190+0000 mgr.y (mgr.24494) 37 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:28:49.977 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:49 smithi104 bash[15781]: cluster 2024-09-15T03:28:49.002190+0000 mgr.y (mgr.24494) 37 : cluster [DBG] pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:28:52.358 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:52 smithi104 bash[15781]: cluster 2024-09-15T03:28:51.002909+0000 mgr.y (mgr.24494) 38 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:52.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:52 smithi053 bash[15077]: cluster 2024-09-15T03:28:51.002909+0000 mgr.y (mgr.24494) 38 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:52.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:52 smithi053 bash[21662]: cluster 2024-09-15T03:28:51.002909+0000 mgr.y (mgr.24494) 38 : cluster [DBG] pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:53.276 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-09-15T03:28:53.276 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQB1VOZmkC8MEBAAuWUo/A1MoB9XG8ZUBm224w== 2024-09-15T03:28:53.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:53 smithi053 bash[21662]: audit 2024-09-15T03:28:52.178987+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:53 smithi053 bash[21662]: audit 2024-09-15T03:28:52.187016+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:53 smithi053 bash[21662]: audit 2024-09-15T03:28:52.193535+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:53 smithi053 bash[15077]: audit 2024-09-15T03:28:52.178987+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:53 smithi053 bash[15077]: audit 2024-09-15T03:28:52.187016+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:53 smithi053 bash[15077]: audit 2024-09-15T03:28:52.193535+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:53 smithi104 bash[15781]: audit 2024-09-15T03:28:52.178987+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:53 smithi104 bash[15781]: audit 2024-09-15T03:28:52.187016+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:53.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:53 smithi104 bash[15781]: audit 2024-09-15T03:28:52.193535+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:54.291 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:54 smithi053 systemd[1]: Stopping Ceph alertmanager.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:28:54.291 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[21662]: cluster 2024-09-15T03:28:53.003961+0000 mgr.y (mgr.24494) 39 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:28:54.291 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[21662]: audit 2024-09-15T03:28:53.268188+0000 mon.c (mon.2) 16 : audit [INF] from='client.? 172.21.15.53:0/1227900463' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:28:54.291 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[21662]: audit 2024-09-15T03:28:53.268935+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:28:54.292 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[21662]: audit 2024-09-15T03:28:53.274443+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T03:28:54.292 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[15077]: cluster 2024-09-15T03:28:53.003961+0000 mgr.y (mgr.24494) 39 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:28:54.292 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[15077]: audit 2024-09-15T03:28:53.268188+0000 mon.c (mon.2) 16 : audit [INF] from='client.? 172.21.15.53:0/1227900463' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:28:54.292 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[15077]: audit 2024-09-15T03:28:53.268935+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:28:54.292 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[15077]: audit 2024-09-15T03:28:53.274443+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T03:28:54.381 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:28:54.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T03:28:54.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T03:28:54.405 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T03:28:54.413 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:28:54 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:28:54] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:28:54.413 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:54 smithi104 bash[15781]: cluster 2024-09-15T03:28:53.003961+0000 mgr.y (mgr.24494) 39 : cluster [DBG] pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:28:54.413 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:54 smithi104 bash[15781]: audit 2024-09-15T03:28:53.268188+0000 mon.c (mon.2) 16 : audit [INF] from='client.? 172.21.15.53:0/1227900463' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:28:54.414 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:54 smithi104 bash[15781]: audit 2024-09-15T03:28:53.268935+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:28:54.414 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:54 smithi104 bash[15781]: audit 2024-09-15T03:28:53.274443+0000 mon.a (mon.0) 1121 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T03:28:54.553 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[48597]: ts=2024-09-15T03:28:54.289Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-15T03:28:54.553 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[48597]: ts=2024-09-15T03:28:54.289Z caller=cluster.go:690 level=info component=cluster msg="gossip not settled but continuing anyway" polls=4 elapsed=9.664585136s 2024-09-15T03:28:55.191 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:54 smithi053 bash[49996]: ceph-aed93852-7310-11ef-bceb-c7b262605968-alertmanager-a 2024-09-15T03:28:55.191 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:55 smithi053 bash[50061]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-alertmanager-a 2024-09-15T03:28:55.191 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:55 smithi053 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@alertmanager.a.service: Succeeded. 2024-09-15T03:28:55.191 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:55 smithi053 systemd[1]: Stopped Ceph alertmanager.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:28:55.191 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:55 smithi053 systemd[1]: Started Ceph alertmanager.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:28:56.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:56 smithi104 bash[15781]: cluster 2024-09-15T03:28:55.005200+0000 mgr.y (mgr.24494) 40 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:56.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:56 smithi104 bash[15781]: audit 2024-09-15T03:28:55.071667+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:56.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:56 smithi104 bash[15781]: audit 2024-09-15T03:28:55.078922+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:56.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:56 smithi104 bash[15781]: cephadm 2024-09-15T03:28:55.080927+0000 mgr.y (mgr.24494) 41 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-15T03:28:56.344 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:56 smithi104 bash[15781]: cephadm 2024-09-15T03:28:55.092156+0000 mgr.y (mgr.24494) 42 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi104 2024-09-15T03:28:56.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[21662]: cluster 2024-09-15T03:28:55.005200+0000 mgr.y (mgr.24494) 40 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:56.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[21662]: audit 2024-09-15T03:28:55.071667+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:56.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[21662]: audit 2024-09-15T03:28:55.078922+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:56.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[21662]: cephadm 2024-09-15T03:28:55.080927+0000 mgr.y (mgr.24494) 41 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-15T03:28:56.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[21662]: cephadm 2024-09-15T03:28:55.092156+0000 mgr.y (mgr.24494) 42 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi104 2024-09-15T03:28:56.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[15077]: cluster 2024-09-15T03:28:55.005200+0000 mgr.y (mgr.24494) 40 : cluster [DBG] pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:56.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[15077]: audit 2024-09-15T03:28:55.071667+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:56.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[15077]: audit 2024-09-15T03:28:55.078922+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:56.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[15077]: cephadm 2024-09-15T03:28:55.080927+0000 mgr.y (mgr.24494) 41 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-09-15T03:28:56.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:56 smithi053 bash[15077]: cephadm 2024-09-15T03:28:55.092156+0000 mgr.y (mgr.24494) 42 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi104 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.327Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.328Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.330Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.53 port=9094 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.331Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.372Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.372Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.377Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-09-15T03:28:57.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:57 smithi053 bash[50091]: ts=2024-09-15T03:28:57.377Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-15T03:28:58.206 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:28:58 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:28:58.206 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:58 smithi104 bash[15781]: cluster 2024-09-15T03:28:57.005771+0000 mgr.y (mgr.24494) 43 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:58.206 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:58 smithi104 bash[15781]: audit 2024-09-15T03:28:57.086108+0000 mon.a (mon.0) 1124 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:58.207 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:58 smithi104 bash[15781]: audit 2024-09-15T03:28:57.918942+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.207 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:58 smithi104 bash[15781]: audit 2024-09-15T03:28:57.926203+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.207 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:58 smithi104 bash[15781]: audit 2024-09-15T03:28:57.933738+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[15077]: cluster 2024-09-15T03:28:57.005771+0000 mgr.y (mgr.24494) 43 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[15077]: audit 2024-09-15T03:28:57.086108+0000 mon.a (mon.0) 1124 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[15077]: audit 2024-09-15T03:28:57.918942+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[15077]: audit 2024-09-15T03:28:57.926203+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[15077]: audit 2024-09-15T03:28:57.933738+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[21662]: cluster 2024-09-15T03:28:57.005771+0000 mgr.y (mgr.24494) 43 : cluster [DBG] pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[21662]: audit 2024-09-15T03:28:57.086108+0000 mon.a (mon.0) 1124 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:28:58.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[21662]: audit 2024-09-15T03:28:57.918942+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[21662]: audit 2024-09-15T03:28:57.926203+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:58.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:58 smithi053 bash[21662]: audit 2024-09-15T03:28:57.933738+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:28:59.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[15781]: audit 2024-09-15T03:28:58.035020+0000 mgr.y (mgr.24494) 44 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:58 smithi104 systemd[1]: Stopping Ceph prometheus.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.053Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.054Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.055Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.055Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-15T03:28:59.235 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[41532]: ts=2024-09-15T03:28:59.055Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-15T03:28:59.339 INFO:teuthology.orchestra.run.smithi104.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T03:28:59.440 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:28:59 smithi053 bash[50091]: ts=2024-09-15T03:28:59.332Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000512288s 2024-09-15T03:28:59.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:28:59 smithi053 bash[15077]: audit 2024-09-15T03:28:58.035020+0000 mgr.y (mgr.24494) 44 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:59.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:28:59 smithi053 bash[21662]: audit 2024-09-15T03:28:58.035020+0000 mgr.y (mgr.24494) 44 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:28:59.985 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:28:59 smithi104 bash[44015]: ceph-aed93852-7310-11ef-bceb-c7b262605968-prometheus-a 2024-09-15T03:29:00.389 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15077]: cluster 2024-09-15T03:28:59.007225+0000 mgr.y (mgr.24494) 45 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:00.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15077]: audit 2024-09-15T03:28:59.458747+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15077]: audit 2024-09-15T03:28:59.467268+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.390 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15077]: audit 2024-09-15T03:28:59.474927+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.390 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[21662]: cluster 2024-09-15T03:28:59.007225+0000 mgr.y (mgr.24494) 45 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:00.390 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[21662]: audit 2024-09-15T03:28:59.458747+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.390 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[21662]: audit 2024-09-15T03:28:59.467268+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.390 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[21662]: audit 2024-09-15T03:28:59.474927+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.391 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15335]: [15/Sep/2024:03:29:00] ENGINE Bus STOPPING 2024-09-15T03:29:00.423 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:00 smithi104 bash[15781]: cluster 2024-09-15T03:28:59.007225+0000 mgr.y (mgr.24494) 45 : cluster [DBG] pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:00.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:00 smithi104 bash[15781]: audit 2024-09-15T03:28:59.458747+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:00 smithi104 bash[15781]: audit 2024-09-15T03:28:59.467268+0000 mon.a (mon.0) 1129 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:00 smithi104 bash[15781]: audit 2024-09-15T03:28:59.474927+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:00.424 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:00 smithi104 bash[44100]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-prometheus-a 2024-09-15T03:29:00.424 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:00 smithi104 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@prometheus.a.service: Succeeded. 2024-09-15T03:29:00.424 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:00 smithi104 systemd[1]: Stopped Ceph prometheus.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:29:00.424 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:00 smithi104 systemd[1]: Started Ceph prometheus.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:29:01.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15335]: [15/Sep/2024:03:29:00] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-15T03:29:01.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15335]: [15/Sep/2024:03:29:00] ENGINE Bus STOPPED 2024-09-15T03:29:01.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15335]: [15/Sep/2024:03:29:00] ENGINE Bus STARTING 2024-09-15T03:29:01.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15335]: [15/Sep/2024:03:29:00] ENGINE Serving on http://:::9283 2024-09-15T03:29:01.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15335]: [15/Sep/2024:03:29:00] ENGINE Bus STARTED 2024-09-15T03:29:01.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:00 smithi053 bash[15335]: [15/Sep/2024:03:29:00] ENGINE Bus STOPPING 2024-09-15T03:29:01.626 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-15T03:29:01.626 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Bus STOPPED 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Bus STARTING 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Serving on http://:::9283 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Bus STARTED 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Bus STOPPING 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Bus STOPPED 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Bus STARTING 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Serving on http://:::9283 2024-09-15T03:29:01.627 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15335]: [15/Sep/2024:03:29:01] ENGINE Bus STARTED 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.344414+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.351429+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.357542+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.358147+0000 mgr.y (mgr.24494) 46 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.360054+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.360535+0000 mgr.y (mgr.24494) 47 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.367417+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.378622+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.379369+0000 mgr.y (mgr.24494) 48 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.386686+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi104.front.sepia.ceph.com:9095"}]: dispatch 2024-09-15T03:29:01.628 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.387351+0000 mgr.y (mgr.24494) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi104.front.sepia.ceph.com:9095"}]: dispatch 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.398328+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.413148+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.415958+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.417165+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.426838+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.516435+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.521495+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.527008+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.527696+0000 mgr.y (mgr.24494) 50 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: audit 2024-09-15T03:29:00.536229+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: cephadm 2024-09-15T03:29:00.558580+0000 mgr.y (mgr.24494) 51 : cephadm [INF] Deploying daemon grafana.a on smithi104 2024-09-15T03:29:01.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[15077]: cluster 2024-09-15T03:29:01.007930+0000 mgr.y (mgr.24494) 52 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.344414+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.351429+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.357542+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.358147+0000 mgr.y (mgr.24494) 46 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.360054+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.360535+0000 mgr.y (mgr.24494) 47 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.367417+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.378622+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.379369+0000 mgr.y (mgr.24494) 48 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.386686+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi104.front.sepia.ceph.com:9095"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.387351+0000 mgr.y (mgr.24494) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi104.front.sepia.ceph.com:9095"}]: dispatch 2024-09-15T03:29:01.630 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.398328+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.413148+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.415958+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.417165+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.426838+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.516435+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.521495+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.527008+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.527696+0000 mgr.y (mgr.24494) 50 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: audit 2024-09-15T03:29:00.536229+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: cephadm 2024-09-15T03:29:00.558580+0000 mgr.y (mgr.24494) 51 : cephadm [INF] Deploying daemon grafana.a on smithi104 2024-09-15T03:29:01.631 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:01 smithi053 bash[21662]: cluster 2024-09-15T03:29:01.007930+0000 mgr.y (mgr.24494) 52 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.344414+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.351429+0000 mon.a (mon.0) 1132 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.357542+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.358147+0000 mgr.y (mgr.24494) 46 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.360054+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.360535+0000 mgr.y (mgr.24494) 47 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi053.front.sepia.ceph.com:9093"}]: dispatch 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.367417+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.378622+0000 mon.a (mon.0) 1136 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-15T03:29:01.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.379369+0000 mgr.y (mgr.24494) 48 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.386686+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi104.front.sepia.ceph.com:9095"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.387351+0000 mgr.y (mgr.24494) 49 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi104.front.sepia.ceph.com:9095"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.398328+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.413148+0000 mon.a (mon.0) 1139 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.415958+0000 mon.a (mon.0) 1140 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.417165+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.426838+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.516435+0000 mon.a (mon.0) 1143 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.521495+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.527008+0000 mon.a (mon.0) 1145 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.527696+0000 mgr.y (mgr.24494) 50 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: audit 2024-09-15T03:29:00.536229+0000 mon.a (mon.0) 1146 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:01.736 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: cephadm 2024-09-15T03:29:00.558580+0000 mgr.y (mgr.24494) 51 : cephadm [INF] Deploying daemon grafana.a on smithi104 2024-09-15T03:29:01.737 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:01 smithi104 bash[15781]: cluster 2024-09-15T03:29:01.007930+0000 mgr.y (mgr.24494) 52 : cluster [DBG] pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:03.273 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.261Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-15T03:29:03.273 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.261Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.261Z caller=main.go:570 level=info host_details="(Linux 5.15.0-121-generic #131~20.04.1-Ubuntu SMP Mon Aug 12 13:09:56 UTC 2024 x86_64 smithi104 (none))" 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.261Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.261Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.262Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.263Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.264Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.264Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.267Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.267Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=3.102µs 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.267Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.269Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.269Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-09-15T03:29:03.274 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.269Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=51.79µs wal_replay_duration=2.301738ms wbl_replay_duration=150ns total_replay_duration=2.411349ms 2024-09-15T03:29:03.734 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.271Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-15T03:29:03.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.271Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-15T03:29:03.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.271Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-15T03:29:03.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.289Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.378926ms db_storage=1.188µs remote_storage=1.32µs web_handler=450ns query_engine=1.028µs scrape=267.423µs scrape_sd=48.158µs notify=32.744µs notify_sd=9.236µs rules=17.596701ms tracing=6.265µs 2024-09-15T03:29:03.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.289Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-15T03:29:03.735 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:29:03 smithi104 bash[44126]: ts=2024-09-15T03:29:03.289Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-15T03:29:04.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:04 smithi053 bash[15077]: cluster 2024-09-15T03:29:03.008862+0000 mgr.y (mgr.24494) 53 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:04.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:04 smithi053 bash[21662]: cluster 2024-09-15T03:29:03.008862+0000 mgr.y (mgr.24494) 53 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:04.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:04 smithi104 bash[15781]: cluster 2024-09-15T03:29:03.008862+0000 mgr.y (mgr.24494) 53 : cluster [DBG] pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:06.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:06 smithi053 bash[15077]: cluster 2024-09-15T03:29:05.009689+0000 mgr.y (mgr.24494) 54 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:06.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:06 smithi053 bash[21662]: cluster 2024-09-15T03:29:05.009689+0000 mgr.y (mgr.24494) 54 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:06.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:06 smithi104 bash[15781]: cluster 2024-09-15T03:29:05.009689+0000 mgr.y (mgr.24494) 54 : cluster [DBG] pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:07.691 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:29:07 smithi053 bash[50091]: ts=2024-09-15T03:29:07.333Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00179763s 2024-09-15T03:29:08.397 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:29:08 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:29:08.398 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:08 smithi104 bash[15781]: cluster 2024-09-15T03:29:07.010399+0000 mgr.y (mgr.24494) 55 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:08.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:08 smithi053 bash[21662]: cluster 2024-09-15T03:29:07.010399+0000 mgr.y (mgr.24494) 55 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:08.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:08 smithi053 bash[15077]: cluster 2024-09-15T03:29:07.010399+0000 mgr.y (mgr.24494) 55 : cluster [DBG] pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:08.900 INFO:teuthology.orchestra.run.smithi104.stdout:[client.1] 2024-09-15T03:29:08.901 INFO:teuthology.orchestra.run.smithi104.stdout: key = AQCEVOZm7TslNRAA4SaacypDS9Ac4YIj/9Rxfg== 2024-09-15T03:29:09.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:09 smithi104 bash[15781]: audit 2024-09-15T03:29:08.042925+0000 mgr.y (mgr.24494) 56 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:09.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:09 smithi104 bash[15781]: audit 2024-09-15T03:29:08.887921+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.104:0/1410089948' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:29:09.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:09 smithi104 bash[15781]: audit 2024-09-15T03:29:08.891333+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:29:09.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:09 smithi104 bash[15781]: audit 2024-09-15T03:29:08.898612+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[21662]: audit 2024-09-15T03:29:08.042925+0000 mgr.y (mgr.24494) 56 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[21662]: audit 2024-09-15T03:29:08.887921+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.104:0/1410089948' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[21662]: audit 2024-09-15T03:29:08.891333+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[21662]: audit 2024-09-15T03:29:08.898612+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[15077]: audit 2024-09-15T03:29:08.042925+0000 mgr.y (mgr.24494) 56 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[15077]: audit 2024-09-15T03:29:08.887921+0000 mon.b (mon.1) 32 : audit [INF] from='client.? 172.21.15.104:0/1410089948' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[15077]: audit 2024-09-15T03:29:08.891333+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T03:29:09.350 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:09 smithi053 bash[15077]: audit 2024-09-15T03:29:08.898612+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T03:29:10.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:10 smithi053 bash[15077]: cluster 2024-09-15T03:29:09.011855+0000 mgr.y (mgr.24494) 57 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:10.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:10 smithi053 bash[21662]: cluster 2024-09-15T03:29:09.011855+0000 mgr.y (mgr.24494) 57 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:10.634 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:10 smithi104 bash[15781]: cluster 2024-09-15T03:29:09.011855+0000 mgr.y (mgr.24494) 57 : cluster [DBG] pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:11.860 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:29:11.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-15T03:29:11.860 DEBUG:teuthology.orchestra.run.smithi104:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T03:29:11.925 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T03:29:11.925 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T03:29:11.926 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[21662]: cluster 2024-09-15T03:29:11.012287+0000 mgr.y (mgr.24494) 58 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[21662]: audit 2024-09-15T03:29:11.597249+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[21662]: audit 2024-09-15T03:29:11.604123+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[21662]: audit 2024-09-15T03:29:11.610182+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[15077]: cluster 2024-09-15T03:29:11.012287+0000 mgr.y (mgr.24494) 58 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[15077]: audit 2024-09-15T03:29:11.597249+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[15077]: audit 2024-09-15T03:29:11.604123+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[15077]: audit 2024-09-15T03:29:11.610182+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:12 smithi104 bash[15781]: cluster 2024-09-15T03:29:11.012287+0000 mgr.y (mgr.24494) 58 : cluster [DBG] pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:12.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:12 smithi104 bash[15781]: audit 2024-09-15T03:29:11.597249+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:12 smithi104 bash[15781]: audit 2024-09-15T03:29:11.604123+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:12.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:12 smithi104 bash[15781]: audit 2024-09-15T03:29:11.610182+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:13.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:13 smithi053 bash[15077]: audit 2024-09-15T03:29:12.085651+0000 mon.a (mon.0) 1152 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:13.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:12 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:12] "GET /metrics HTTP/1.1" 200 219653 "" "Prometheus/2.43.0" 2024-09-15T03:29:13.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:13 smithi053 bash[21662]: audit 2024-09-15T03:29:12.085651+0000 mon.a (mon.0) 1152 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:13.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:13 smithi104 bash[15781]: audit 2024-09-15T03:29:12.085651+0000 mon.a (mon.0) 1152 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:14.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:14 smithi104 bash[15781]: cluster 2024-09-15T03:29:13.013445+0000 mgr.y (mgr.24494) 59 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:14.235 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:29:14 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:29:14.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:14 smithi053 bash[21662]: cluster 2024-09-15T03:29:13.013445+0000 mgr.y (mgr.24494) 59 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:14.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:14 smithi053 bash[15077]: cluster 2024-09-15T03:29:13.013445+0000 mgr.y (mgr.24494) 59 : cluster [DBG] pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:16.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:16 smithi053 bash[21662]: cluster 2024-09-15T03:29:15.014146+0000 mgr.y (mgr.24494) 60 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:16.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:16 smithi053 bash[15077]: cluster 2024-09-15T03:29:15.014146+0000 mgr.y (mgr.24494) 60 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:16.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:16 smithi104 bash[15781]: cluster 2024-09-15T03:29:15.014146+0000 mgr.y (mgr.24494) 60 : cluster [DBG] pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:16.810 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:18.399 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:18 smithi104 bash[15781]: cluster 2024-09-15T03:29:17.014868+0000 mgr.y (mgr.24494) 61 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:18.399 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:29:18 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:29:18.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:18 smithi053 bash[21662]: cluster 2024-09-15T03:29:17.014868+0000 mgr.y (mgr.24494) 61 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:18.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:18 smithi053 bash[15077]: cluster 2024-09-15T03:29:17.014868+0000 mgr.y (mgr.24494) 61 : cluster [DBG] pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:19.424 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:19 smithi104 bash[15781]: audit 2024-09-15T03:29:18.050761+0000 mgr.y (mgr.24494) 62 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:19.425 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:19 smithi104 bash[15781]: audit 2024-09-15T03:29:18.140843+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.425 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:19 smithi104 bash[15781]: audit 2024-09-15T03:29:18.146905+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.425 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:19 smithi104 bash[15781]: audit 2024-09-15T03:29:18.152601+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[21662]: audit 2024-09-15T03:29:18.050761+0000 mgr.y (mgr.24494) 62 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:19.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[21662]: audit 2024-09-15T03:29:18.140843+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[21662]: audit 2024-09-15T03:29:18.146905+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[21662]: audit 2024-09-15T03:29:18.152601+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[15077]: audit 2024-09-15T03:29:18.050761+0000 mgr.y (mgr.24494) 62 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:19.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[15077]: audit 2024-09-15T03:29:18.140843+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[15077]: audit 2024-09-15T03:29:18.146905+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:19.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:19 smithi053 bash[15077]: audit 2024-09-15T03:29:18.152601+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.051 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15335]: [15/Sep/2024:03:29:20] ENGINE Bus STOPPING 2024-09-15T03:29:20.172 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:29:20.342 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: cluster 2024-09-15T03:29:19.016337+0000 mgr.y (mgr.24494) 63 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:20.342 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.405322+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.342 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.413547+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.342 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.420470+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.342 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.913517+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.342 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.921887+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.930042+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.935242+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.974938+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.978774+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.980089+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:19.987595+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.032688+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.035035+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi104.front.sepia.ceph.com:3000"}]: dispatch 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.041634+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.052647+0000 mon.a (mon.0) 1170 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.057588+0000 mon.a (mon.0) 1171 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.343 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.058938+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.344 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.066071+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.344 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.108995+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.344 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.111288+0000 mon.a (mon.0) 1175 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.344 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.112106+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.344 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:20 smithi104 bash[15781]: audit 2024-09-15T03:29:20.118657+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: cluster 2024-09-15T03:29:19.016337+0000 mgr.y (mgr.24494) 63 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.405322+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.413547+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.420470+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.913517+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.921887+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.930042+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.935242+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.974938+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.376 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.978774+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.980089+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:19.987595+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.032688+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.035035+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi104.front.sepia.ceph.com:3000"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.041634+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.052647+0000 mon.a (mon.0) 1170 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.057588+0000 mon.a (mon.0) 1171 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.058938+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.066071+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.108995+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.111288+0000 mon.a (mon.0) 1175 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.112106+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.377 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15077]: audit 2024-09-15T03:29:20.118657+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: cluster 2024-09-15T03:29:19.016337+0000 mgr.y (mgr.24494) 63 : cluster [DBG] pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.405322+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.413547+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.420470+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.913517+0000 mon.a (mon.0) 1159 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.921887+0000 mon.a (mon.0) 1160 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.930042+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.935242+0000 mon.a (mon.0) 1162 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.974938+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.978774+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.980089+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.378 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:19.987595+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.032688+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.035035+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi104.front.sepia.ceph.com:3000"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.041634+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.052647+0000 mon.a (mon.0) 1170 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.057588+0000 mon.a (mon.0) 1171 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.058938+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.066071+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.108995+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.111288+0000 mon.a (mon.0) 1175 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.112106+0000 mon.a (mon.0) 1176 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:20.379 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[21662]: audit 2024-09-15T03:29:20.118657+0000 mon.a (mon.0) 1177 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:20.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15335]: [15/Sep/2024:03:29:20] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-15T03:29:20.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15335]: [15/Sep/2024:03:29:20] ENGINE Bus STOPPED 2024-09-15T03:29:20.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15335]: [15/Sep/2024:03:29:20] ENGINE Bus STARTING 2024-09-15T03:29:20.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15335]: [15/Sep/2024:03:29:20] ENGINE Serving on http://:::9283 2024-09-15T03:29:20.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:20 smithi053 bash[15335]: [15/Sep/2024:03:29:20] ENGINE Bus STARTED 2024-09-15T03:29:20.887 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":21,"flags":0,"active_gid":24494,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1580544394},{"type":"v1","addr":"172.21.15.53:6801","nonce":1580544394}]},"active_addr":"172.21.15.53:6801/1580544394","active_change":"2024-09-15T03:28:26.976028+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":24508,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.53:8443/","prometheus":"http://172.21.15.53:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":74,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":2927942825}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":814349938}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1270991717}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.53:0","nonce":1868970837}]}]} 2024-09-15T03:29:20.890 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T03:29:20.891 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T03:29:20.891 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T03:29:21.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[15077]: cephadm 2024-09-15T03:29:19.988082+0000 mgr.y (mgr.24494) 64 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[15077]: audit 2024-09-15T03:29:20.033671+0000 mgr.y (mgr.24494) 65 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-15T03:29:21.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[15077]: audit 2024-09-15T03:29:20.035701+0000 mgr.y (mgr.24494) 66 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi104.front.sepia.ceph.com:3000"}]: dispatch 2024-09-15T03:29:21.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[15077]: cephadm 2024-09-15T03:29:20.066645+0000 mgr.y (mgr.24494) 67 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[15077]: cephadm 2024-09-15T03:29:20.119226+0000 mgr.y (mgr.24494) 68 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[15077]: audit 2024-09-15T03:29:20.165525+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.53:0/4218395096' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T03:29:21.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[21662]: cephadm 2024-09-15T03:29:19.988082+0000 mgr.y (mgr.24494) 64 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[21662]: audit 2024-09-15T03:29:20.033671+0000 mgr.y (mgr.24494) 65 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-15T03:29:21.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[21662]: audit 2024-09-15T03:29:20.035701+0000 mgr.y (mgr.24494) 66 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi104.front.sepia.ceph.com:3000"}]: dispatch 2024-09-15T03:29:21.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[21662]: cephadm 2024-09-15T03:29:20.066645+0000 mgr.y (mgr.24494) 67 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[21662]: cephadm 2024-09-15T03:29:20.119226+0000 mgr.y (mgr.24494) 68 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.442 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:21 smithi053 bash[21662]: audit 2024-09-15T03:29:20.165525+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.53:0/4218395096' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T03:29:21.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:21 smithi104 bash[15781]: cephadm 2024-09-15T03:29:19.988082+0000 mgr.y (mgr.24494) 64 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:21 smithi104 bash[15781]: audit 2024-09-15T03:29:20.033671+0000 mgr.y (mgr.24494) 65 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-15T03:29:21.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:21 smithi104 bash[15781]: audit 2024-09-15T03:29:20.035701+0000 mgr.y (mgr.24494) 66 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi104.front.sepia.ceph.com:3000"}]: dispatch 2024-09-15T03:29:21.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:21 smithi104 bash[15781]: cephadm 2024-09-15T03:29:20.066645+0000 mgr.y (mgr.24494) 67 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:21 smithi104 bash[15781]: cephadm 2024-09-15T03:29:20.119226+0000 mgr.y (mgr.24494) 68 : cephadm [INF] Metadata not up to date on all hosts. Skipping non agent specs 2024-09-15T03:29:21.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:21 smithi104 bash[15781]: audit 2024-09-15T03:29:20.165525+0000 mon.c (mon.2) 17 : audit [DBG] from='client.? 172.21.15.53:0/4218395096' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T03:29:22.345 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[15781]: cluster 2024-09-15T03:29:21.016839+0000 mgr.y (mgr.24494) 69 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:22.345 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[15781]: audit 2024-09-15T03:29:22.100692+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:22.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:22 smithi053 bash[15077]: cluster 2024-09-15T03:29:21.016839+0000 mgr.y (mgr.24494) 69 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:22.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:22 smithi053 bash[15077]: audit 2024-09-15T03:29:22.100692+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:22.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:22 smithi053 bash[21662]: cluster 2024-09-15T03:29:21.016839+0000 mgr.y (mgr.24494) 69 : cluster [DBG] pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:22.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:22 smithi053 bash[21662]: audit 2024-09-15T03:29:22.100692+0000 mon.a (mon.0) 1178 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:22.627 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.580272279Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-09-15T03:29:22.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.622433869Z level=info msg="Executing migration" id="create user table v2" 2024-09-15T03:29:22.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.664224678Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-09-15T03:29:22.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.708337645Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-09-15T03:29:22.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.754117535Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-09-15T03:29:22.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.804390754Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-09-15T03:29:22.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.82959945Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-09-15T03:29:22.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.854744243Z level=info msg="Executing migration" id="Update user table charset" 2024-09-15T03:29:22.903 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.897571614Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-09-15T03:29:23.171 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.947194695Z level=info msg="Executing migration" id="Add missing user data" 2024-09-15T03:29:23.171 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:22 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:22.972482063Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-09-15T03:29:23.171 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.016471754Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-09-15T03:29:23.171 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.044265164Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-09-15T03:29:23.172 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.069350888Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-09-15T03:29:23.172 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.114417494Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-09-15T03:29:23.172 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.16706037Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-09-15T03:29:23.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:22 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:22] "GET /metrics HTTP/1.1" 200 219653 "" "Prometheus/2.43.0" 2024-09-15T03:29:23.441 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.215111864Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-09-15T03:29:23.441 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.240467254Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-09-15T03:29:23.441 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.283532993Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-09-15T03:29:23.441 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.34948866Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-09-15T03:29:23.441 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.391344375Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-09-15T03:29:23.733 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.436723474Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-15T03:29:23.733 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.462143304Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-15T03:29:23.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.537638918Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-15T03:29:23.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.629643732Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-15T03:29:23.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.72968749Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-15T03:29:23.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.849677345Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-15T03:29:23.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:23 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:23.967311804Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-15T03:29:24.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:24 smithi053 bash[15077]: cluster 2024-09-15T03:29:23.018040+0000 mgr.y (mgr.24494) 70 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:24.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:24 smithi053 bash[21662]: cluster 2024-09-15T03:29:23.018040+0000 mgr.y (mgr.24494) 70 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:24.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:24.229548933Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-15T03:29:24.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[15781]: cluster 2024-09-15T03:29:23.018040+0000 mgr.y (mgr.24494) 70 : cluster [DBG] pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:24.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:29:24.801 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:24.497483836Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-15T03:29:24.802 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:24.572985451Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-15T03:29:24.802 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:24.623508403Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-15T03:29:24.802 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:24.686022215Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-15T03:29:24.802 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:24.728962155Z level=info msg="Executing migration" id="create star table" 2024-09-15T03:29:25.088 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:24 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:24.796023932Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-15T03:29:25.340 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:25 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:25.084595282Z level=info msg="Executing migration" id="create org table v1" 2024-09-15T03:29:25.651 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:25 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:25.355486594Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-15T03:29:25.651 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:25 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:25.463253082Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-15T03:29:25.665 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:25.984 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:25 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:25.647522055Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-15T03:29:26.307 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:25 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:25.99550604Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-15T03:29:26.307 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.127542149Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-15T03:29:26.308 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.194698958Z level=info msg="Executing migration" id="Update org table charset" 2024-09-15T03:29:26.308 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[15781]: cluster 2024-09-15T03:29:25.018869+0000 mgr.y (mgr.24494) 71 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:26.308 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[15781]: audit 2024-09-15T03:29:26.002789+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.308 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[15781]: audit 2024-09-15T03:29:26.009805+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.308 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[15781]: audit 2024-09-15T03:29:26.015805+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[15077]: cluster 2024-09-15T03:29:25.018869+0000 mgr.y (mgr.24494) 71 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[15077]: audit 2024-09-15T03:29:26.002789+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[15077]: audit 2024-09-15T03:29:26.009805+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[15077]: audit 2024-09-15T03:29:26.015805+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[21662]: cluster 2024-09-15T03:29:25.018869+0000 mgr.y (mgr.24494) 71 : cluster [DBG] pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[21662]: audit 2024-09-15T03:29:26.002789+0000 mon.a (mon.0) 1179 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[21662]: audit 2024-09-15T03:29:26.009805+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:26 smithi053 bash[21662]: audit 2024-09-15T03:29:26.015805+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:26.604 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.303463493Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-15T03:29:26.605 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.370441401Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-15T03:29:26.605 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.468083556Z level=info msg="Executing migration" id="create dashboard table" 2024-09-15T03:29:26.605 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.532729202Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-15T03:29:26.605 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.600604669Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-15T03:29:26.877 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.650295246Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-15T03:29:26.896 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.687706638Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-15T03:29:26.896 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.735758306Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-15T03:29:26.896 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.805193624Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-15T03:29:26.897 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.8725851Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-15T03:29:27.183 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:26 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:26.954050922Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-15T03:29:27.183 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.062302933Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-15T03:29:27.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:27 smithi053 bash[21662]: audit 2024-09-15T03:29:27.087355+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:27.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:27 smithi053 bash[15077]: audit 2024-09-15T03:29:27.087355+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:27.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.260191976Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-15T03:29:27.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[15781]: audit 2024-09-15T03:29:27.087355+0000 mon.a (mon.0) 1182 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:27.853 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.517056403Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-15T03:29:27.853 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.652045937Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-15T03:29:27.854 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.765345561Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-15T03:29:27.854 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.84935253Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-15T03:29:28.182 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:29:28 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:29:28.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.91436458Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-15T03:29:28.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.939628803Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-15T03:29:28.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:27 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:27.98160512Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-15T03:29:28.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:28 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:28.04462552Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-15T03:29:28.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:28 smithi053 bash[15077]: cluster 2024-09-15T03:29:27.019624+0000 mgr.y (mgr.24494) 72 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:28 smithi053 bash[21662]: cluster 2024-09-15T03:29:27.019624+0000 mgr.y (mgr.24494) 72 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:28.484 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:28 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:28.267668697Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-15T03:29:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:28 smithi104 bash[15781]: cluster 2024-09-15T03:29:27.019624+0000 mgr.y (mgr.24494) 72 : cluster [DBG] pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:28.984 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:28 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:28.645034258Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-15T03:29:28.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:28 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:28.747618166Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-15T03:29:28.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:28 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:28.814727258Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-15T03:29:29.306 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.032662203Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-15T03:29:29.306 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.208308069Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-15T03:29:29.306 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[15781]: audit 2024-09-15T03:29:28.058933+0000 mgr.y (mgr.24494) 73 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:29.521 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:29 smithi053 bash[21662]: audit 2024-09-15T03:29:28.058933+0000 mgr.y (mgr.24494) 73 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:29.521 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:29 smithi053 bash[15077]: audit 2024-09-15T03:29:28.058933+0000 mgr.y (mgr.24494) 73 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:29.561 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.302104609Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-15T03:29:29.561 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.401313546Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-15T03:29:29.561 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.503142622Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-15T03:29:29.814 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.557256258Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-15T03:29:29.814 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.619366872Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-15T03:29:29.814 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.702614508Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-15T03:29:29.814 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.76699055Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-15T03:29:30.094 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.817649292Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-15T03:29:30.094 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.868453188Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-15T03:29:30.095 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.935905004Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-15T03:29:30.095 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:29 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:29.961424068Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-15T03:29:30.095 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.00343086Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-15T03:29:30.095 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.025071444Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-15T03:29:30.095 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.050347393Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-15T03:29:30.095 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.090605794Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-15T03:29:30.370 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[15781]: cluster 2024-09-15T03:29:29.020588+0000 mgr.y (mgr.24494) 74 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:30.370 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.115976074Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-15T03:29:30.370 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.137913424Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-15T03:29:30.370 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.179917959Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-15T03:29:30.370 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.223778634Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-15T03:29:30.371 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.26680462Z level=info msg="Executing migration" id="create data_source table" 2024-09-15T03:29:30.371 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.32620795Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-15T03:29:30.371 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.366182456Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-15T03:29:30.443 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:30 smithi053 bash[15077]: cluster 2024-09-15T03:29:29.020588+0000 mgr.y (mgr.24494) 74 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:30.443 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:30 smithi053 bash[21662]: cluster 2024-09-15T03:29:29.020588+0000 mgr.y (mgr.24494) 74 : cluster [DBG] pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:30.641 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.42580232Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-15T03:29:30.641 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.460917671Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-15T03:29:30.641 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.501492691Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-15T03:29:30.641 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.544254614Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-15T03:29:30.641 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.587391571Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-15T03:29:30.820 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:29:30.820 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"aed93852-7310-11ef-bceb-c7b262605968","created":"2024-09-15T03:16:02.948210+0000","modified":"2024-09-15T03:28:26.975627+0000","last_up_change":"2024-09-15T03:26:41.098600+0000","last_in_change":"2024-09-15T03:26:10.205904+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T03:21:44.024345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-15T03:27:22.900025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-15T03:27:24.902821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-09-15T03:27:26.868996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"datapool","create_time":"2024-09-15T03:27:28.500296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-15T03:27:29.073614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"979ed5a1-4f04-4b3d-8cde-e20ffdacd018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6803","nonce":3384339896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6805","nonce":3384339896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6809","nonce":3384339896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6807","nonce":3384339896}]},"public_addr":"172.21.15.53:6803/3384339896","cluster_addr":"172.21.15.53:6805/3384339896","heartbeat_back_addr":"172.21.15.53:6809/3384339896","heartbeat_front_addr":"172.21.15.53:6807/3384339896","state":["exists","up"]},{"osd":1,"uuid":"404e0f2b-d138-4c1a-a29c-9b33c3d56c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6811","nonce":2958260182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6813","nonce":2958260182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6817","nonce":2958260182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6815","nonce":2958260182}]},"public_addr":"172.21.15.53:6811/2958260182","cluster_addr":"172.21.15.53:6813/2958260182","heartbeat_back_addr":"172.21.15.53:6817/2958260182","heartbeat_front_addr":"172.21.15.53:6815/2958260182","state":["exists","up"]},{"osd":2,"uuid":"46f21d02-74d9-4af2-9404-bd0388c25103","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6819","nonce":3584076472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6821","nonce":3584076472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6825","nonce":3584076472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6823","nonce":3584076472}]},"public_addr":"172.21.15.53:6819/3584076472","cluster_addr":"172.21.15.53:6821/3584076472","heartbeat_back_addr":"172.21.15.53:6825/3584076472","heartbeat_front_addr":"172.21.15.53:6823/3584076472","state":["exists","up"]},{"osd":3,"uuid":"89da8702-b0ab-4acc-89dc-8e53d40e80bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6827","nonce":418709263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6829","nonce":418709263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6833","nonce":418709263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6831","nonce":418709263}]},"public_addr":"172.21.15.53:6827/418709263","cluster_addr":"172.21.15.53:6829/418709263","heartbeat_back_addr":"172.21.15.53:6833/418709263","heartbeat_front_addr":"172.21.15.53:6831/418709263","state":["exists","up"]},{"osd":4,"uuid":"006ec282-23db-4141-b688-4a95655e74a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6801","nonce":3793887825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6803","nonce":3793887825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6807","nonce":3793887825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6805","nonce":3793887825}]},"public_addr":"172.21.15.104:6801/3793887825","cluster_addr":"172.21.15.104:6803/3793887825","heartbeat_back_addr":"172.21.15.104:6807/3793887825","heartbeat_front_addr":"172.21.15.104:6805/3793887825","state":["exists","up"]},{"osd":5,"uuid":"8cb3c0d1-577c-4dcc-aa8a-543858692116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6809","nonce":1629567730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6811","nonce":1629567730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6815","nonce":1629567730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6813","nonce":1629567730}]},"public_addr":"172.21.15.104:6809/1629567730","cluster_addr":"172.21.15.104:6811/1629567730","heartbeat_back_addr":"172.21.15.104:6815/1629567730","heartbeat_front_addr":"172.21.15.104:6813/1629567730","state":["exists","up"]},{"osd":6,"uuid":"1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6817","nonce":1526170749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6819","nonce":1526170749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6823","nonce":1526170749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6821","nonce":1526170749}]},"public_addr":"172.21.15.104:6817/1526170749","cluster_addr":"172.21.15.104:6819/1526170749","heartbeat_back_addr":"172.21.15.104:6823/1526170749","heartbeat_front_addr":"172.21.15.104:6821/1526170749","state":["exists","up"]},{"osd":7,"uuid":"31d4fbee-353b-4551-8c13-9e3d7bc06df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6825","nonce":760848612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6827","nonce":760848612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6831","nonce":760848612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6829","nonce":760848612}]},"public_addr":"172.21.15.104:6825/760848612","cluster_addr":"172.21.15.104:6827/760848612","heartbeat_back_addr":"172.21.15.104:6831/760848612","heartbeat_front_addr":"172.21.15.104:6829/760848612","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:19:49.611527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:20:48.305182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:21:41.360867+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:22:38.023361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:23:39.862596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:24:40.303806+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:25:43.369424+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:26:39.651188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/3538438633":"2024-09-16T03:28:26.975519+0000","172.21.15.53:6801/2245745119":"2024-09-16T03:28:26.975519+0000","172.21.15.53:6800/2245745119":"2024-09-16T03:28:26.975519+0000","172.21.15.53:0/398086559":"2024-09-16T03:28:26.975519+0000","172.21.15.53:6801/3102449096":"2024-09-16T03:16:30.414782+0000","172.21.15.53:0/883853116":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6801/2710749493":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/59274638":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6800/3102449096":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6800/2710749493":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/1779232001":"2024-09-16T03:16:30.414782+0000","172.21.15.53:0/1734477862":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/4143972155":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/2168382242":"2024-09-16T03:28:26.975519+0000","172.21.15.53:0/1234566788":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/4070391809":"2024-09-16T03:28:26.975519+0000","172.21.15.53:0/4191873918":"2024-09-16T03:28:26.975519+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T03:29:30.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.636937843Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-15T03:29:30.902 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.662271822Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-15T03:29:30.903 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.712906584Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-15T03:29:30.903 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.755745861Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-15T03:29:30.903 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.781021656Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-15T03:29:30.903 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.824951914Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-15T03:29:30.903 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.898314081Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-15T03:29:31.215 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.941368003Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-15T03:29:31.215 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:30 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:30.967347915Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-15T03:29:31.215 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:31.027426826Z level=info msg="Executing migration" id="Add uid column" 2024-09-15T03:29:31.215 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:31.11137035Z level=info msg="Executing migration" id="Update uid value" 2024-09-15T03:29:31.216 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:31.211342377Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-15T03:29:31.484 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:31.338137138Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-15T03:29:31.518 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T03:29:31.518 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T03:29:31.826 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:31.540588943Z level=info msg="Executing migration" id="create api_key table" 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.716086+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.722063+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.725245+0000 mon.a (mon.0) 1185 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.728761+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.731583+0000 mon.a (mon.0) 1187 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.732573+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.738705+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: audit 2024-09-15T03:29:30.813334+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.53:0/294067912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:29:31.827 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[15781]: cluster 2024-09-15T03:29:31.021068+0000 mgr.y (mgr.24494) 75 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.716086+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.722063+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.725245+0000 mon.a (mon.0) 1185 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.728761+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.731583+0000 mon.a (mon.0) 1187 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.732573+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.738705+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: audit 2024-09-15T03:29:30.813334+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.53:0/294067912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:29:31.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[21662]: cluster 2024-09-15T03:29:31.021068+0000 mgr.y (mgr.24494) 75 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:31.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.716086+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.722063+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.725245+0000 mon.a (mon.0) 1185 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:29:31.943 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.728761+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.731583+0000 mon.a (mon.0) 1187 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:29:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.732573+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:29:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.738705+0000 mon.a (mon.0) 1189 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: audit 2024-09-15T03:29:30.813334+0000 mon.b (mon.1) 33 : audit [DBG] from='client.? 172.21.15.53:0/294067912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:29:31.944 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:31 smithi053 bash[15077]: cluster 2024-09-15T03:29:31.021068+0000 mgr.y (mgr.24494) 75 : cluster [DBG] pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:32.107 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:31.822642378Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-15T03:29:32.107 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:31 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:31.960468785Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-15T03:29:32.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.038015418Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-15T03:29:32.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.103036902Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.145910291Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.17212763Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.200978374Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.238615863Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.264301944Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.308152076Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.344596884Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-15T03:29:32.398 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.390008038Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-15T03:29:32.652 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.432931605Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-15T03:29:32.652 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.459472508Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-15T03:29:32.652 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.485731768Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-15T03:29:32.652 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.510934964Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-15T03:29:32.652 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.536971437Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-15T03:29:32.653 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.579619422Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-15T03:29:32.653 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.621636877Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-15T03:29:32.653 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.648098737Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-15T03:29:32.939 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.700437583Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-15T03:29:32.939 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.743378073Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-15T03:29:32.939 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.768560253Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-15T03:29:32.939 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.794909485Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-15T03:29:32.939 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.821151086Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-15T03:29:32.939 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.863831663Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-15T03:29:32.939 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.934928591Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-15T03:29:33.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:32 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:32] "GET /metrics HTTP/1.1" 200 219646 "" "Prometheus/2.43.0" 2024-09-15T03:29:33.204 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.965122924Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-15T03:29:33.205 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:32 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:32.991154501Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-15T03:29:33.205 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.033166834Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-15T03:29:33.205 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.062003266Z level=info msg="Executing migration" id="create quota table v1" 2024-09-15T03:29:33.205 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.087290686Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-15T03:29:33.205 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.130788796Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-15T03:29:33.205 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.17473494Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-15T03:29:33.205 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.200440812Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-15T03:29:33.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[15781]: audit 2024-09-15T03:29:32.281077+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[15781]: audit 2024-09-15T03:29:32.289495+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[15781]: audit 2024-09-15T03:29:32.297479+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.222757369Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-15T03:29:33.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.264700563Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-15T03:29:33.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.30312666Z level=info msg="Executing migration" id="create session table" 2024-09-15T03:29:33.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.328567776Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-15T03:29:33.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.366525318Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-15T03:29:33.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.392338168Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-15T03:29:33.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.435360725Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-15T03:29:33.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:33 smithi053 bash[21662]: audit 2024-09-15T03:29:32.281077+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:33 smithi053 bash[21662]: audit 2024-09-15T03:29:32.289495+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:33 smithi053 bash[21662]: audit 2024-09-15T03:29:32.297479+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:33 smithi053 bash[15077]: audit 2024-09-15T03:29:32.281077+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:33 smithi053 bash[15077]: audit 2024-09-15T03:29:32.289495+0000 mon.a (mon.0) 1191 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:33 smithi053 bash[15077]: audit 2024-09-15T03:29:32.297479+0000 mon.a (mon.0) 1192 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.485709899Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.527749944Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.565362736Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.607379726Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.649427793Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.681071774Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.70446823Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-15T03:29:33.754 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.749727656Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-15T03:29:34.028 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.778666026Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-15T03:29:34.028 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.80461864Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-15T03:29:34.028 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.830027798Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-15T03:29:34.028 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.856451902Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-15T03:29:34.029 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.881772156Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-15T03:29:34.029 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.907153972Z level=info msg="Executing migration" id="create alert table v1" 2024-09-15T03:29:34.029 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.932245459Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-15T03:29:34.029 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.959838079Z level=info msg="Executing migration" id="add index alert state" 2024-09-15T03:29:34.029 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:33 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:33.982300896Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-15T03:29:34.295 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:34] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:29:34.295 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.024390983Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-15T03:29:34.295 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.067243877Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-15T03:29:34.295 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.095979073Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-15T03:29:34.296 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.122044437Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-15T03:29:34.296 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.172423695Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-15T03:29:34.296 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.235517661Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-15T03:29:34.296 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.264681487Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-15T03:29:34.296 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.290952759Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-15T03:29:34.572 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[15781]: cluster 2024-09-15T03:29:33.022317+0000 mgr.y (mgr.24494) 76 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:34.572 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.345908643Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-15T03:29:34.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.374916009Z level=info msg="Executing migration" id="Add column is_default" 2024-09-15T03:29:34.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.417748273Z level=info msg="Executing migration" id="Add column frequency" 2024-09-15T03:29:34.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.446137241Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-15T03:29:34.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.488178212Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-15T03:29:34.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.514656795Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-15T03:29:34.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.568499121Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-15T03:29:34.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:34 smithi053 bash[21662]: cluster 2024-09-15T03:29:33.022317+0000 mgr.y (mgr.24494) 76 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:34.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:34 smithi053 bash[15077]: cluster 2024-09-15T03:29:33.022317+0000 mgr.y (mgr.24494) 76 : cluster [DBG] pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:34.823 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.611623878Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-15T03:29:34.823 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.632354759Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-15T03:29:34.823 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.675195308Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-15T03:29:34.823 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.70503272Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-15T03:29:34.823 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.750817773Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-15T03:29:34.824 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.79366003Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-15T03:29:34.824 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.818864194Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-15T03:29:35.090 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.846937194Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.872207537Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.914473246Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.940566193Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.968666759Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:34 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:34.993997672Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.036018054Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.061360865Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-15T03:29:35.091 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.086548313Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.111891983Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.153807251Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.190947048Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.216213899Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.257976859Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.283443701Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.325446339Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-15T03:29:35.355 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.35066631Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-15T03:29:35.618 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.387230456Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-15T03:29:35.618 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.429230092Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-15T03:29:35.618 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.471170579Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-15T03:29:35.618 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.513327748Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-15T03:29:35.618 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.538678375Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-15T03:29:35.618 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.588762552Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-15T03:29:35.618 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.614041834Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-15T03:29:35.869 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.659492418Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-15T03:29:35.869 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.70159622Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-15T03:29:35.869 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.743501237Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-15T03:29:35.869 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.76882519Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-15T03:29:35.869 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.810827146Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-15T03:29:35.869 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.839213673Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-15T03:29:35.869 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.864913373Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-15T03:29:36.149 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.890158879Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.915345906Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.957397799Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:35 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:35.982508529Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.024530829Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.052866526Z level=info msg="Executing migration" id="Move region to single row" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.078088192Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.103376751Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-15T03:29:36.150 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.145348302Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-15T03:29:36.305 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:36.405 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[15781]: cluster 2024-09-15T03:29:35.023000+0000 mgr.y (mgr.24494) 77 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:36.405 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.170677049Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.212518889Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.237899097Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.258106654Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.28358196Z level=info msg="Executing migration" id="create test_data table" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.325657349Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.35095556Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.376169819Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-15T03:29:36.406 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.40148749Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.42665594Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.471894438Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.497208095Z level=info msg="Executing migration" id="create team table" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.522460037Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.564575032Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.589856176Z level=info msg="Executing migration" id="create team member table" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.610121343Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.635486533Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-15T03:29:36.665 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.660640486Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-15T03:29:36.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:36 smithi053 bash[21662]: cluster 2024-09-15T03:29:35.023000+0000 mgr.y (mgr.24494) 77 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:36.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:36 smithi053 bash[15077]: cluster 2024-09-15T03:29:35.023000+0000 mgr.y (mgr.24494) 77 : cluster [DBG] pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:36.929 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.702724834Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-15T03:29:36.929 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.761614609Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-15T03:29:36.929 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.795003701Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-15T03:29:36.929 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.824184749Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-15T03:29:36.929 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.849453413Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-15T03:29:36.929 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.874826033Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-15T03:29:36.929 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.899920053Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-15T03:29:37.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.925117921Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-15T03:29:37.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:36 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:36.96242713Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-15T03:29:37.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.004496246Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-15T03:29:37.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.029848247Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-15T03:29:37.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.071834628Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-15T03:29:37.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.10111862Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-15T03:29:37.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.126420128Z level=info msg="Executing migration" id="create tag table" 2024-09-15T03:29:37.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.151688359Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-15T03:29:37.182 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.176969123Z level=info msg="Executing migration" id="create login attempt table" 2024-09-15T03:29:37.432 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.202169148Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-15T03:29:37.432 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.222780898Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-15T03:29:37.432 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.264678728Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-15T03:29:37.432 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.298352156Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-15T03:29:37.432 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.340375511Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-15T03:29:37.432 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.374205932Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-15T03:29:37.432 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.428061495Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.453485003Z level=info msg="Executing migration" id="create user auth table" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.478718376Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.52059405Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.54154797Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.583638967Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.60891746Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.634231525Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-15T03:29:37.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.676209964Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-15T03:29:37.984 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.730127371Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.755402528Z level=info msg="Executing migration" id="create server_lock table" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.780651516Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.806047179Z level=info msg="Executing migration" id="create user auth token table" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.831223387Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.860494838Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.885686075Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.910967896Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.936196857Z level=info msg="Executing migration" id="create cache_data table" 2024-09-15T03:29:37.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:37 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:37.961441875Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-15T03:29:38.288 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:29:38.288 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.032168712Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-15T03:29:38.288 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.057381928Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-15T03:29:38.288 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.099850877Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-15T03:29:38.288 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.128681577Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-15T03:29:38.289 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.170703764Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-15T03:29:38.289 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.196080606Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-15T03:29:38.289 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.221368332Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-15T03:29:38.289 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.263237508Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-15T03:29:38.289 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.284107565Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-15T03:29:38.572 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[15781]: cluster 2024-09-15T03:29:37.023705+0000 mgr.y (mgr.24494) 78 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:38.572 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.325988309Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-15T03:29:38.572 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.368038592Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-15T03:29:38.572 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.393312274Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-15T03:29:38.572 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.430753908Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-15T03:29:38.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.456028205Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-15T03:29:38.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.481256882Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-15T03:29:38.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.506519659Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-15T03:29:38.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.531810305Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-15T03:29:38.573 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.568207075Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-15T03:29:38.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:38 smithi053 bash[21662]: cluster 2024-09-15T03:29:37.023705+0000 mgr.y (mgr.24494) 78 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:38.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:38 smithi053 bash[15077]: cluster 2024-09-15T03:29:37.023705+0000 mgr.y (mgr.24494) 78 : cluster [DBG] pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:38.828 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.593764307Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-15T03:29:38.829 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.635800009Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-15T03:29:38.829 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.663636388Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-15T03:29:38.829 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.702955469Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-15T03:29:38.829 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.744916975Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-15T03:29:38.829 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.770352671Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-15T03:29:38.829 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.797793904Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-15T03:29:38.829 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.824535444Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.849822139Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.874956643Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.925745974Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.969468123Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:38 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:38.994689382Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.020119015Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.047134876Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.072412165Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-15T03:29:39.108 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.10371447Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-15T03:29:39.381 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[15781]: audit 2024-09-15T03:29:38.067280+0000 mgr.y (mgr.24494) 79 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:39.381 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.145664382Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-15T03:29:39.381 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.171029958Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-15T03:29:39.381 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.196359217Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-15T03:29:39.381 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.221654882Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-15T03:29:39.381 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.263514925Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-15T03:29:39.381 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.290735281Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-15T03:29:39.382 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.332659489Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-15T03:29:39.382 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.376827694Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-15T03:29:39.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:39 smithi053 bash[21662]: audit 2024-09-15T03:29:38.067280+0000 mgr.y (mgr.24494) 79 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:39 smithi053 bash[15077]: audit 2024-09-15T03:29:38.067280+0000 mgr.y (mgr.24494) 79 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:39.517 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:29:39.517 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":74,"fsid":"aed93852-7310-11ef-bceb-c7b262605968","created":"2024-09-15T03:16:02.948210+0000","modified":"2024-09-15T03:28:26.975627+0000","last_up_change":"2024-09-15T03:26:41.098600+0000","last_in_change":"2024-09-15T03:26:10.205904+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T03:21:44.024345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-15T03:27:22.900025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-15T03:27:24.902821+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-09-15T03:27:26.868996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"datapool","create_time":"2024-09-15T03:27:28.500296+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-09-15T03:27:29.073614+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"979ed5a1-4f04-4b3d-8cde-e20ffdacd018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6803","nonce":3384339896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6805","nonce":3384339896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6809","nonce":3384339896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":3384339896},{"type":"v1","addr":"172.21.15.53:6807","nonce":3384339896}]},"public_addr":"172.21.15.53:6803/3384339896","cluster_addr":"172.21.15.53:6805/3384339896","heartbeat_back_addr":"172.21.15.53:6809/3384339896","heartbeat_front_addr":"172.21.15.53:6807/3384339896","state":["exists","up"]},{"osd":1,"uuid":"404e0f2b-d138-4c1a-a29c-9b33c3d56c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6811","nonce":2958260182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6813","nonce":2958260182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6817","nonce":2958260182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2958260182},{"type":"v1","addr":"172.21.15.53:6815","nonce":2958260182}]},"public_addr":"172.21.15.53:6811/2958260182","cluster_addr":"172.21.15.53:6813/2958260182","heartbeat_back_addr":"172.21.15.53:6817/2958260182","heartbeat_front_addr":"172.21.15.53:6815/2958260182","state":["exists","up"]},{"osd":2,"uuid":"46f21d02-74d9-4af2-9404-bd0388c25103","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6819","nonce":3584076472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6821","nonce":3584076472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6825","nonce":3584076472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":3584076472},{"type":"v1","addr":"172.21.15.53:6823","nonce":3584076472}]},"public_addr":"172.21.15.53:6819/3584076472","cluster_addr":"172.21.15.53:6821/3584076472","heartbeat_back_addr":"172.21.15.53:6825/3584076472","heartbeat_front_addr":"172.21.15.53:6823/3584076472","state":["exists","up"]},{"osd":3,"uuid":"89da8702-b0ab-4acc-89dc-8e53d40e80bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6827","nonce":418709263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6829","nonce":418709263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6833","nonce":418709263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":418709263},{"type":"v1","addr":"172.21.15.53:6831","nonce":418709263}]},"public_addr":"172.21.15.53:6827/418709263","cluster_addr":"172.21.15.53:6829/418709263","heartbeat_back_addr":"172.21.15.53:6833/418709263","heartbeat_front_addr":"172.21.15.53:6831/418709263","state":["exists","up"]},{"osd":4,"uuid":"006ec282-23db-4141-b688-4a95655e74a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6800","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6801","nonce":3793887825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6802","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6803","nonce":3793887825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6806","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6807","nonce":3793887825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6804","nonce":3793887825},{"type":"v1","addr":"172.21.15.104:6805","nonce":3793887825}]},"public_addr":"172.21.15.104:6801/3793887825","cluster_addr":"172.21.15.104:6803/3793887825","heartbeat_back_addr":"172.21.15.104:6807/3793887825","heartbeat_front_addr":"172.21.15.104:6805/3793887825","state":["exists","up"]},{"osd":5,"uuid":"8cb3c0d1-577c-4dcc-aa8a-543858692116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6808","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6809","nonce":1629567730}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6810","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6811","nonce":1629567730}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6814","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6815","nonce":1629567730}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6812","nonce":1629567730},{"type":"v1","addr":"172.21.15.104:6813","nonce":1629567730}]},"public_addr":"172.21.15.104:6809/1629567730","cluster_addr":"172.21.15.104:6811/1629567730","heartbeat_back_addr":"172.21.15.104:6815/1629567730","heartbeat_front_addr":"172.21.15.104:6813/1629567730","state":["exists","up"]},{"osd":6,"uuid":"1ee5bbb9-8e8f-40b7-bf24-9d64af6274fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6816","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6817","nonce":1526170749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6818","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6819","nonce":1526170749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6822","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6823","nonce":1526170749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6820","nonce":1526170749},{"type":"v1","addr":"172.21.15.104:6821","nonce":1526170749}]},"public_addr":"172.21.15.104:6817/1526170749","cluster_addr":"172.21.15.104:6819/1526170749","heartbeat_back_addr":"172.21.15.104:6823/1526170749","heartbeat_front_addr":"172.21.15.104:6821/1526170749","state":["exists","up"]},{"osd":7,"uuid":"31d4fbee-353b-4551-8c13-9e3d7bc06df0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6824","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6825","nonce":760848612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6826","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6827","nonce":760848612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6830","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6831","nonce":760848612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.104:6828","nonce":760848612},{"type":"v1","addr":"172.21.15.104:6829","nonce":760848612}]},"public_addr":"172.21.15.104:6825/760848612","cluster_addr":"172.21.15.104:6827/760848612","heartbeat_back_addr":"172.21.15.104:6831/760848612","heartbeat_front_addr":"172.21.15.104:6829/760848612","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:19:49.611527+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:20:48.305182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:21:41.360867+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:22:38.023361+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:23:39.862596+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:24:40.303806+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:25:43.369424+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T03:26:39.651188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.9","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.53:0/3538438633":"2024-09-16T03:28:26.975519+0000","172.21.15.53:6801/2245745119":"2024-09-16T03:28:26.975519+0000","172.21.15.53:6800/2245745119":"2024-09-16T03:28:26.975519+0000","172.21.15.53:0/398086559":"2024-09-16T03:28:26.975519+0000","172.21.15.53:6801/3102449096":"2024-09-16T03:16:30.414782+0000","172.21.15.53:0/883853116":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6801/2710749493":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/59274638":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6800/3102449096":"2024-09-16T03:16:30.414782+0000","172.21.15.53:6800/2710749493":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/1779232001":"2024-09-16T03:16:30.414782+0000","172.21.15.53:0/1734477862":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/4143972155":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/2168382242":"2024-09-16T03:28:26.975519+0000","172.21.15.53:0/1234566788":"2024-09-16T03:17:03.366758+0000","172.21.15.53:0/4070391809":"2024-09-16T03:28:26.975519+0000","172.21.15.53:0/4191873918":"2024-09-16T03:28:26.975519+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.402149123Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.445831299Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.487678981Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.531468262Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.573541505Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.601065398Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.626331625Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-15T03:29:39.660 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.655689229Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-15T03:29:39.933 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.697615482Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-15T03:29:39.933 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.739867356Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-15T03:29:39.933 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.783478712Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-15T03:29:39.933 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.808714925Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-15T03:29:39.933 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.83406535Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-15T03:29:39.933 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.861195259Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-15T03:29:39.934 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.886493864Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-15T03:29:39.934 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.928499641Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-15T03:29:40.184 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.95704524Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-15T03:29:40.184 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:39 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:39.982274859Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-15T03:29:40.184 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.007616711Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-15T03:29:40.184 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.049604672Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-15T03:29:40.184 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.074888476Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-15T03:29:40.185 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.121710515Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-15T03:29:40.185 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.179805056Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-15T03:29:40.187 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T03:29:40.188 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T03:29:40.188 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T03:29:40.188 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T03:29:40.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T03:29:40.189 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T03:29:40.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T03:29:40.190 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T03:29:40.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:40 smithi053 bash[21662]: cluster 2024-09-15T03:29:39.024629+0000 mgr.y (mgr.24494) 80 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:40 smithi053 bash[21662]: audit 2024-09-15T03:29:39.513286+0000 mon.a (mon.0) 1193 : audit [DBG] from='client.? 172.21.15.53:0/1570004018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:29:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:40 smithi053 bash[15077]: cluster 2024-09-15T03:29:39.024629+0000 mgr.y (mgr.24494) 80 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:40 smithi053 bash[15077]: audit 2024-09-15T03:29:39.513286+0000 mon.a (mon.0) 1193 : audit [DBG] from='client.? 172.21.15.53:0/1570004018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:29:40.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.288791259Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-15T03:29:40.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.37645574Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-15T03:29:40.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[15781]: cluster 2024-09-15T03:29:39.024629+0000 mgr.y (mgr.24494) 80 : cluster [DBG] pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:40.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[15781]: audit 2024-09-15T03:29:39.513286+0000 mon.a (mon.0) 1193 : audit [DBG] from='client.? 172.21.15.53:0/1570004018' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T03:29:40.863 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.509616159Z level=info msg="Executing migration" id="create alert_image table" 2024-09-15T03:29:41.156 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:40 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:40.859386176Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-15T03:29:41.156 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.003131217Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-15T03:29:41.424 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.152433951Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-15T03:29:41.729 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.420450908Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-15T03:29:41.729 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.582788033Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-15T03:29:41.729 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.582958183Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-15T03:29:41.729 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.649783228Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-15T03:29:41.729 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.725281747Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-15T03:29:41.984 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.817354063Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-09-15T03:29:41.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.817603218Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-09-15T03:29:41.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.817813721Z level=info msg="alerts found to migrate" alerts=0 2024-09-15T03:29:41.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.899196368Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-15T03:29:42.276 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:41 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:41.99144423Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-15T03:29:42.277 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.066933552Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-15T03:29:42.277 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.146325102Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-15T03:29:42.277 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.201445084Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-15T03:29:42.277 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.226708874Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-15T03:29:42.277 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.272599947Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-15T03:29:42.538 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[15781]: cluster 2024-09-15T03:29:41.025286+0000 mgr.y (mgr.24494) 81 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:42.538 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[15781]: audit 2024-09-15T03:29:42.088553+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:42.538 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.322813194Z level=info msg="Executing migration" id="create data_keys table" 2024-09-15T03:29:42.538 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.390432912Z level=info msg="Executing migration" id="create secrets table" 2024-09-15T03:29:42.538 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.450167304Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-15T03:29:42.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:42 smithi053 bash[21662]: cluster 2024-09-15T03:29:41.025286+0000 mgr.y (mgr.24494) 81 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:42.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:42 smithi053 bash[21662]: audit 2024-09-15T03:29:42.088553+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:42.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:42 smithi053 bash[15077]: cluster 2024-09-15T03:29:41.025286+0000 mgr.y (mgr.24494) 81 : cluster [DBG] pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:42.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:42 smithi053 bash[15077]: audit 2024-09-15T03:29:42.088553+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:42.914 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.53391964Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-15T03:29:42.914 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.662419727Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-15T03:29:43.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:42 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:42] "GET /metrics HTTP/1.1" 200 219661 "" "Prometheus/2.43.0" 2024-09-15T03:29:43.235 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:42 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:42.910628808Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-15T03:29:43.235 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.154348062Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-15T03:29:43.584 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.30831611Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-15T03:29:43.584 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.384304833Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-15T03:29:43.585 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.425673508Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-15T03:29:43.585 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.472734093Z level=info msg="Executing migration" id="create permission table" 2024-09-15T03:29:43.585 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.512691321Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-15T03:29:43.585 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.580062899Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-15T03:29:44.148 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:43 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:43.837170598Z level=info msg="Executing migration" id="create role table" 2024-09-15T03:29:44.148 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:44] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:29:44.447 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[15781]: cluster 2024-09-15T03:29:43.026653+0000 mgr.y (mgr.24494) 82 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:44.447 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:44.144303079Z level=info msg="Executing migration" id="add column display_name" 2024-09-15T03:29:44.447 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:44.22245657Z level=info msg="Executing migration" id="add column group_name" 2024-09-15T03:29:44.621 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:44 smithi053 bash[21662]: cluster 2024-09-15T03:29:43.026653+0000 mgr.y (mgr.24494) 82 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:44.621 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:44 smithi053 bash[15077]: cluster 2024-09-15T03:29:43.026653+0000 mgr.y (mgr.24494) 82 : cluster [DBG] pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:44.734 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:44.443210606Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-15T03:29:44.735 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:44.636237204Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-15T03:29:45.087 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:44.803487138Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-15T03:29:45.087 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:44.898454329Z level=info msg="Executing migration" id="create team role table" 2024-09-15T03:29:45.087 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:44 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:44.991711814Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-15T03:29:45.087 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.08328689Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-15T03:29:45.088 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.088 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.089 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.090 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.090 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.090 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.091 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.095 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:29:45.342 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.143073462Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-15T03:29:45.342 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.193405436Z level=info msg="Executing migration" id="create user role table" 2024-09-15T03:29:45.342 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.257834916Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-15T03:29:45.342 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.323763228Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-15T03:29:45.653 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.371360053Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-15T03:29:45.653 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.413634179Z level=info msg="Executing migration" id="create builtin role table" 2024-09-15T03:29:45.654 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.481459975Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-15T03:29:45.654 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.523167772Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-15T03:29:45.654 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.565555461Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-15T03:29:45.654 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.60754047Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-15T03:29:45.911 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.649487097Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-15T03:29:45.912 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.674989199Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-15T03:29:45.912 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.700238739Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-15T03:29:45.912 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.74212119Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-15T03:29:45.912 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.784171732Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-15T03:29:45.912 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.826179848Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-15T03:29:45.913 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.865460851Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-15T03:29:46.180 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.907506735Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-15T03:29:46.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.9495072Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-15T03:29:46.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:45 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:45.991534459Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-15T03:29:46.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.040641303Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-15T03:29:46.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.083808834Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-15T03:29:46.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.109051602Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-15T03:29:46.181 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.151456716Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-15T03:29:46.445 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.176597781Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-15T03:29:46.445 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.218621217Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-15T03:29:46.445 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.260897996Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-15T03:29:46.445 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.302743878Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-15T03:29:46.445 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.344647296Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-15T03:29:46.445 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.38677458Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-15T03:29:46.446 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.412253383Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-15T03:29:46.446 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.441244744Z level=info msg="Executing migration" id="add correlation config column" 2024-09-15T03:29:46.446 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[15781]: cluster 2024-09-15T03:29:45.027324+0000 mgr.y (mgr.24494) 83 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:46.446 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[15781]: audit 2024-09-15T03:29:46.196500+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.446 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[15781]: audit 2024-09-15T03:29:46.201199+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.446 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[15781]: audit 2024-09-15T03:29:46.206743+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[15077]: cluster 2024-09-15T03:29:45.027324+0000 mgr.y (mgr.24494) 83 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:46.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[15077]: audit 2024-09-15T03:29:46.196500+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[15077]: audit 2024-09-15T03:29:46.201199+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.692 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[15077]: audit 2024-09-15T03:29:46.206743+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[21662]: cluster 2024-09-15T03:29:45.027324+0000 mgr.y (mgr.24494) 83 : cluster [DBG] pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:46.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[21662]: audit 2024-09-15T03:29:46.196500+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[21662]: audit 2024-09-15T03:29:46.201199+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.693 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:46 smithi053 bash[21662]: audit 2024-09-15T03:29:46.206743+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:46.698 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.466434092Z level=info msg="Executing migration" id="create entity_events table" 2024-09-15T03:29:46.698 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.508570786Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-15T03:29:46.698 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.550617169Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-15T03:29:46.699 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.551020175Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-15T03:29:46.699 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.592381428Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-15T03:29:46.699 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.592669503Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-15T03:29:46.699 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.646463495Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-15T03:29:46.699 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.6884279Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-15T03:29:46.969 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.730265444Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-15T03:29:46.969 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.805732447Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-15T03:29:46.969 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:46 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:46.916205039Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-15T03:29:47.234 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:47 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:47.026370181Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-15T03:29:47.234 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:47 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:47.094067731Z level=info msg="Executing migration" id="Drop public config table" 2024-09-15T03:29:47.707 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:47 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:47.311459848Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-15T03:29:47.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:47 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:47.703954035Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-15T03:29:47.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:47 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:47.813404268Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-15T03:29:47.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:47 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:47.889176825Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-15T03:29:47.985 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:47 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:47.951246592Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-15T03:29:48.308 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.001503448Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.043615368Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.068866037Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.110997102Z level=info msg="Executing migration" id="add share column" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.13625193Z level=info msg="Executing migration" id="create default alerting folders" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.161555121Z level=info msg="Executing migration" id="create file table" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.186902429Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.21215481Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.237493735Z level=info msg="Executing migration" id="create file_meta table" 2024-09-15T03:29:48.309 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.304431624Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-15T03:29:48.600 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[15781]: cluster 2024-09-15T03:29:47.027753+0000 mgr.y (mgr.24494) 84 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:48.601 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[15781]: audit 2024-09-15T03:29:47.442845+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.601 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[15781]: audit 2024-09-15T03:29:47.447291+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.601 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[15781]: audit 2024-09-15T03:29:47.452654+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.601 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.346463907Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-15T03:29:48.601 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.388357931Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-15T03:29:48.601 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.436808251Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-15T03:29:48.601 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.462141468Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-15T03:29:48.601 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.487432283Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-15T03:29:48.601 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.512633663Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-15T03:29:48.601 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.554657742Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-15T03:29:48.602 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.596585916Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-15T03:29:48.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[15077]: cluster 2024-09-15T03:29:47.027753+0000 mgr.y (mgr.24494) 84 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:48.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[15077]: audit 2024-09-15T03:29:47.442845+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[15077]: audit 2024-09-15T03:29:47.447291+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[15077]: audit 2024-09-15T03:29:47.452654+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[21662]: cluster 2024-09-15T03:29:47.027753+0000 mgr.y (mgr.24494) 84 : cluster [DBG] pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:48.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[21662]: audit 2024-09-15T03:29:47.442845+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[21662]: audit 2024-09-15T03:29:47.447291+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.692 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:48 smithi053 bash[21662]: audit 2024-09-15T03:29:47.452654+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:29:48.862 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.621886241Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-15T03:29:48.862 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.647356936Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-15T03:29:48.862 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.68927122Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-15T03:29:48.862 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.714742904Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-15T03:29:48.862 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.756685844Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-15T03:29:48.862 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.782137167Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-15T03:29:48.863 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.832641761Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-15T03:29:49.113 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.857862613Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-15T03:29:49.113 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.895009357Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-15T03:29:49.113 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.945414264Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-15T03:29:49.113 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.970485868Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-15T03:29:49.114 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:48 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:48.99592484Z level=info msg="Executing migration" id="create folder table" 2024-09-15T03:29:49.114 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:49.037886441Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-15T03:29:49.114 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:49.058676138Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-15T03:29:49.114 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:49.0839867Z level=info msg="Executing migration" id="Update folder title length" 2024-09-15T03:29:49.114 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:49.109183314Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-15T03:29:49.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[15781]: audit 2024-09-15T03:29:48.071095+0000 mgr.y (mgr.24494) 85 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:49.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=migrator t=2024-09-15T03:29:49.134448759Z level=info msg="migrations completed" performed=485 skipped=0 duration=26.791784358s 2024-09-15T03:29:49.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=sqlstore t=2024-09-15T03:29:49.135873927Z level=info msg="Created default organization" 2024-09-15T03:29:49.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=plugin.loader t=2024-09-15T03:29:49.247438359Z level=info msg="Plugin registered" pluginID=input 2024-09-15T03:29:49.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=plugin.loader t=2024-09-15T03:29:49.279210192Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-09-15T03:29:49.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=plugin.loader t=2024-09-15T03:29:49.279248333Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-09-15T03:29:49.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=secrets t=2024-09-15T03:29:49.279286241Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-15T03:29:49.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=query_data t=2024-09-15T03:29:49.281212778Z level=info msg="Query Service initialization" 2024-09-15T03:29:49.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:49 smithi104 bash[45125]: logger=live.push_http t=2024-09-15T03:29:49.285462576Z level=info msg="Live Push Gateway initialization" 2024-09-15T03:29:49.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:49 smithi053 bash[15077]: audit 2024-09-15T03:29:48.071095+0000 mgr.y (mgr.24494) 85 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:49.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:49 smithi053 bash[21662]: audit 2024-09-15T03:29:48.071095+0000 mgr.y (mgr.24494) 85 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:50.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:50 smithi053 bash[15077]: cluster 2024-09-15T03:29:49.028574+0000 mgr.y (mgr.24494) 86 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:50.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:50 smithi053 bash[21662]: cluster 2024-09-15T03:29:49.028574+0000 mgr.y (mgr.24494) 86 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:50.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[15781]: cluster 2024-09-15T03:29:49.028574+0000 mgr.y (mgr.24494) 86 : cluster [DBG] pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:50.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=infra.usagestats.collector t=2024-09-15T03:29:50.205033012Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-15T03:29:50.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=provisioning.datasources t=2024-09-15T03:29:50.205805389Z level=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-09-15T03:29:50.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=provisioning.datasources t=2024-09-15T03:29:50.239632314Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-15T03:29:50.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=provisioning.datasources t=2024-09-15T03:29:50.298125114Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-09-15T03:29:50.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=provisioning.alerting t=2024-09-15T03:29:50.37122676Z level=info msg="starting to provision alerting" 2024-09-15T03:29:50.485 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=provisioning.alerting t=2024-09-15T03:29:50.371286285Z level=info msg="finished to provision alerting" 2024-09-15T03:29:50.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=grafanaStorageLogger t=2024-09-15T03:29:50.37145816Z level=info msg="storage starting" 2024-09-15T03:29:50.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=ngalert.state.manager t=2024-09-15T03:29:50.371820533Z level=info msg="Warming state cache for startup" 2024-09-15T03:29:50.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=http.server t=2024-09-15T03:29:50.376383526Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-15T03:29:50.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=sqlstore.transactions t=2024-09-15T03:29:50.382275676Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-15T03:29:50.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=ngalert.state.manager t=2024-09-15T03:29:50.419418346Z level=info msg="State cache has been initialized" states=0 duration=47.596508ms 2024-09-15T03:29:50.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=ticker t=2024-09-15T03:29:50.419506504Z level=info msg=starting first_tick=2024-09-15T03:30:00Z 2024-09-15T03:29:50.486 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:29:50 smithi104 bash[45125]: logger=ngalert.multiorg.alertmanager t=2024-09-15T03:29:50.419504878Z level=info msg="starting MultiOrg Alertmanager" 2024-09-15T03:29:51.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:51 smithi053 bash[15077]: cluster 2024-09-15T03:29:51.029218+0000 mgr.y (mgr.24494) 87 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:51.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:51 smithi053 bash[21662]: cluster 2024-09-15T03:29:51.029218+0000 mgr.y (mgr.24494) 87 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:51.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:51 smithi104 bash[15781]: cluster 2024-09-15T03:29:51.029218+0000 mgr.y (mgr.24494) 87 : cluster [DBG] pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:29:53.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:29:52 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:52] "GET /metrics HTTP/1.1" 200 219661 "" "Prometheus/2.43.0" 2024-09-15T03:29:54.481 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:54 smithi053 bash[21662]: cluster 2024-09-15T03:29:53.029937+0000 mgr.y (mgr.24494) 88 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:54.481 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:54 smithi053 bash[15077]: cluster 2024-09-15T03:29:53.029937+0000 mgr.y (mgr.24494) 88 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:54.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:54 smithi104 bash[15781]: cluster 2024-09-15T03:29:53.029937+0000 mgr.y (mgr.24494) 88 : cluster [DBG] pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:29:54.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:29:54 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:29:54] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:29:56.355 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:56 smithi104 bash[15781]: cluster 2024-09-15T03:29:55.030610+0000 mgr.y (mgr.24494) 89 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:29:56.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:56 smithi053 bash[15077]: cluster 2024-09-15T03:29:55.030610+0000 mgr.y (mgr.24494) 89 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:29:56.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:56 smithi053 bash[21662]: cluster 2024-09-15T03:29:55.030610+0000 mgr.y (mgr.24494) 89 : cluster [DBG] pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:29:57.372 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:57 smithi104 bash[15781]: audit 2024-09-15T03:29:57.088008+0000 mon.a (mon.0) 1201 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:57.514 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:57 smithi053 bash[15077]: audit 2024-09-15T03:29:57.088008+0000 mon.a (mon.0) 1201 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:57.515 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:57 smithi053 bash[21662]: audit 2024-09-15T03:29:57.088008+0000 mon.a (mon.0) 1201 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:29:58.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:58 smithi053 bash[15077]: cluster 2024-09-15T03:29:57.031280+0000 mgr.y (mgr.24494) 90 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:29:58.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:58 smithi053 bash[21662]: cluster 2024-09-15T03:29:57.031280+0000 mgr.y (mgr.24494) 90 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:29:58.418 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:58 smithi104 bash[15781]: cluster 2024-09-15T03:29:57.031280+0000 mgr.y (mgr.24494) 90 : cluster [DBG] pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:29:58.419 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:29:58 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:29:59.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:29:59 smithi053 bash[15077]: audit 2024-09-15T03:29:58.079000+0000 mgr.y (mgr.24494) 91 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:59.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:29:59 smithi053 bash[21662]: audit 2024-09-15T03:29:58.079000+0000 mgr.y (mgr.24494) 91 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:29:59.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:29:59 smithi104 bash[15781]: audit 2024-09-15T03:29:58.079000+0000 mgr.y (mgr.24494) 91 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:00.234 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:00 smithi104 bash[15781]: cluster 2024-09-15T03:29:59.032783+0000 mgr.y (mgr.24494) 92 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:00.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:00 smithi104 bash[15781]: cluster 2024-09-15T03:30:00.000156+0000 mon.a (mon.0) 1202 : cluster [INF] overall HEALTH_OK 2024-09-15T03:30:00.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:00 smithi053 bash[21662]: cluster 2024-09-15T03:29:59.032783+0000 mgr.y (mgr.24494) 92 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:00.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:00 smithi053 bash[21662]: cluster 2024-09-15T03:30:00.000156+0000 mon.a (mon.0) 1202 : cluster [INF] overall HEALTH_OK 2024-09-15T03:30:00.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:00 smithi053 bash[15077]: cluster 2024-09-15T03:29:59.032783+0000 mgr.y (mgr.24494) 92 : cluster [DBG] pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:00.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:00 smithi053 bash[15077]: cluster 2024-09-15T03:30:00.000156+0000 mon.a (mon.0) 1202 : cluster [INF] overall HEALTH_OK 2024-09-15T03:30:01.239 INFO:teuthology.orchestra.run.smithi053.stdout:197568495669 2024-09-15T03:30:01.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T03:30:02.177 INFO:teuthology.orchestra.run.smithi053.stdout:34359738490 2024-09-15T03:30:02.177 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T03:30:02.371 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:02 smithi053 bash[21662]: cluster 2024-09-15T03:30:01.033418+0000 mgr.y (mgr.24494) 93 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:02.371 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:02 smithi053 bash[15077]: cluster 2024-09-15T03:30:01.033418+0000 mgr.y (mgr.24494) 93 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:02.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:02 smithi104 bash[15781]: cluster 2024-09-15T03:30:01.033418+0000 mgr.y (mgr.24494) 93 : cluster [DBG] pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:03.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:30:02 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:02] "GET /metrics HTTP/1.1" 200 219652 "" "Prometheus/2.43.0" 2024-09-15T03:30:03.819 INFO:teuthology.orchestra.run.smithi053.stdout:55834574960 2024-09-15T03:30:03.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T03:30:04.235 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:30:04 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:30:04.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:04 smithi104 bash[15781]: cluster 2024-09-15T03:30:03.034415+0000 mgr.y (mgr.24494) 94 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:04.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:04 smithi053 bash[15077]: cluster 2024-09-15T03:30:03.034415+0000 mgr.y (mgr.24494) 94 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:04.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:04 smithi053 bash[21662]: cluster 2024-09-15T03:30:03.034415+0000 mgr.y (mgr.24494) 94 : cluster [DBG] pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:04.916 INFO:teuthology.orchestra.run.smithi053.stdout:231928234026 2024-09-15T03:30:04.916 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T03:30:06.011 INFO:teuthology.orchestra.run.smithi053.stdout:77309411429 2024-09-15T03:30:06.012 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T03:30:06.385 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:06 smithi053 bash[21662]: cluster 2024-09-15T03:30:05.035230+0000 mgr.y (mgr.24494) 95 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-15T03:30:06.385 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:06 smithi053 bash[15077]: cluster 2024-09-15T03:30:05.035230+0000 mgr.y (mgr.24494) 95 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-15T03:30:06.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:06 smithi104 bash[15781]: cluster 2024-09-15T03:30:05.035230+0000 mgr.y (mgr.24494) 95 : cluster [DBG] pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-15T03:30:07.095 INFO:teuthology.orchestra.run.smithi053.stdout:128849018958 2024-09-15T03:30:07.096 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T03:30:07.311 INFO:teuthology.orchestra.run.smithi053.stdout:107374182490 2024-09-15T03:30:07.311 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T03:30:07.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[15077]: audit 2024-09-15T03:30:06.380535+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[15077]: audit 2024-09-15T03:30:06.387791+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[15077]: audit 2024-09-15T03:30:06.393795+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.382 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[15077]: cluster 2024-09-15T03:30:07.035880+0000 mgr.y (mgr.24494) 96 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-15T03:30:07.418 INFO:teuthology.orchestra.run.smithi053.stdout:163208757314 2024-09-15T03:30:07.419 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T03:30:07.676 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:07 smithi104 bash[15781]: audit 2024-09-15T03:30:06.380535+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.676 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:07 smithi104 bash[15781]: audit 2024-09-15T03:30:06.387791+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.676 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:07 smithi104 bash[15781]: audit 2024-09-15T03:30:06.393795+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.676 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:07 smithi104 bash[15781]: cluster 2024-09-15T03:30:07.035880+0000 mgr.y (mgr.24494) 96 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-15T03:30:07.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[21662]: audit 2024-09-15T03:30:06.380535+0000 mon.a (mon.0) 1203 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[21662]: audit 2024-09-15T03:30:06.387791+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[21662]: audit 2024-09-15T03:30:06.393795+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:07.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:07 smithi053 bash[21662]: cluster 2024-09-15T03:30:07.035880+0000 mgr.y (mgr.24494) 96 : cluster [DBG] pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-09-15T03:30:08.484 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:30:08 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:30:08.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[21662]: audit 2024-09-15T03:30:07.656693+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[21662]: audit 2024-09-15T03:30:07.664324+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[21662]: audit 2024-09-15T03:30:07.672116+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[21662]: audit 2024-09-15T03:30:08.090496+0000 mgr.y (mgr.24494) 97 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:08.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[15077]: audit 2024-09-15T03:30:07.656693+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[15077]: audit 2024-09-15T03:30:07.664324+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[15077]: audit 2024-09-15T03:30:07.672116+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.942 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:08 smithi053 bash[15077]: audit 2024-09-15T03:30:08.090496+0000 mgr.y (mgr.24494) 97 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:08.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:08 smithi104 bash[15781]: audit 2024-09-15T03:30:07.656693+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:08 smithi104 bash[15781]: audit 2024-09-15T03:30:07.664324+0000 mon.a (mon.0) 1207 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:08 smithi104 bash[15781]: audit 2024-09-15T03:30:07.672116+0000 mon.a (mon.0) 1208 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:08.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:08 smithi104 bash[15781]: audit 2024-09-15T03:30:08.090496+0000 mgr.y (mgr.24494) 97 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:09.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:09 smithi053 bash[15077]: cluster 2024-09-15T03:30:09.036916+0000 mgr.y (mgr.24494) 98 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:09.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:09 smithi053 bash[21662]: cluster 2024-09-15T03:30:09.036916+0000 mgr.y (mgr.24494) 98 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:09.951 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:09.951 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:09.953 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:09.953 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:09.955 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:09.985 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:09 smithi104 bash[15781]: cluster 2024-09-15T03:30:09.036916+0000 mgr.y (mgr.24494) 98 : cluster [DBG] pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:12.358 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:12 smithi053 bash[21662]: cluster 2024-09-15T03:30:11.037648+0000 mgr.y (mgr.24494) 99 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:12.358 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:12 smithi053 bash[21662]: audit 2024-09-15T03:30:12.088683+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:12.359 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:12 smithi053 bash[15077]: cluster 2024-09-15T03:30:11.037648+0000 mgr.y (mgr.24494) 99 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:12.359 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:12 smithi053 bash[15077]: audit 2024-09-15T03:30:12.088683+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:12.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:12 smithi104 bash[15781]: cluster 2024-09-15T03:30:11.037648+0000 mgr.y (mgr.24494) 99 : cluster [DBG] pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:12.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:12 smithi104 bash[15781]: audit 2024-09-15T03:30:12.088683+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:13.177 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:30:12 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:12] "GET /metrics HTTP/1.1" 200 219633 "" "Prometheus/2.43.0" 2024-09-15T03:30:14.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:14 smithi053 bash[15077]: cluster 2024-09-15T03:30:13.039172+0000 mgr.y (mgr.24494) 100 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:14.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:14 smithi053 bash[21662]: cluster 2024-09-15T03:30:13.039172+0000 mgr.y (mgr.24494) 100 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:14.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:14 smithi104 bash[15781]: cluster 2024-09-15T03:30:13.039172+0000 mgr.y (mgr.24494) 100 : cluster [DBG] pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:14.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:30:14 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:30:16.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:16 smithi104 bash[15781]: cluster 2024-09-15T03:30:15.039779+0000 mgr.y (mgr.24494) 101 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:16.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:16 smithi053 bash[15077]: cluster 2024-09-15T03:30:15.039779+0000 mgr.y (mgr.24494) 101 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:16.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:16 smithi053 bash[21662]: cluster 2024-09-15T03:30:15.039779+0000 mgr.y (mgr.24494) 101 : cluster [DBG] pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:17.497 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:17.499 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:17.500 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:18.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:18 smithi053 bash[21662]: cluster 2024-09-15T03:30:17.040493+0000 mgr.y (mgr.24494) 102 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:18.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:18 smithi053 bash[15077]: cluster 2024-09-15T03:30:17.040493+0000 mgr.y (mgr.24494) 102 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:18.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:18 smithi104 bash[15781]: cluster 2024-09-15T03:30:17.040493+0000 mgr.y (mgr.24494) 102 : cluster [DBG] pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:18.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:30:18 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:30:19.167 INFO:teuthology.orchestra.run.smithi053.stdout:55834574964 2024-09-15T03:30:19.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:19 smithi104 bash[15781]: audit 2024-09-15T03:30:18.099187+0000 mgr.y (mgr.24494) 103 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:19.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:19 smithi053 bash[15077]: audit 2024-09-15T03:30:18.099187+0000 mgr.y (mgr.24494) 103 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:19.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:19 smithi053 bash[21662]: audit 2024-09-15T03:30:18.099187+0000 mgr.y (mgr.24494) 103 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:20.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:20 smithi053 bash[15077]: cluster 2024-09-15T03:30:19.041406+0000 mgr.y (mgr.24494) 104 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:20.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:20 smithi053 bash[15077]: audit 2024-09-15T03:30:19.165876+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.53:0/140844305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T03:30:20.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:20 smithi053 bash[21662]: cluster 2024-09-15T03:30:19.041406+0000 mgr.y (mgr.24494) 104 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:20.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:20 smithi053 bash[21662]: audit 2024-09-15T03:30:19.165876+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.53:0/140844305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T03:30:20.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:20 smithi104 bash[15781]: cluster 2024-09-15T03:30:19.041406+0000 mgr.y (mgr.24494) 104 : cluster [DBG] pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:20.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:20 smithi104 bash[15781]: audit 2024-09-15T03:30:19.165876+0000 mon.c (mon.2) 18 : audit [DBG] from='client.? 172.21.15.53:0/140844305' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T03:30:21.109 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574960 got 55834574964 for osd.1 2024-09-15T03:30:21.109 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:21.526 INFO:teuthology.orchestra.run.smithi053.stdout:34359738494 2024-09-15T03:30:21.598 INFO:teuthology.orchestra.run.smithi053.stdout:77309411432 2024-09-15T03:30:21.768 INFO:teuthology.orchestra.run.smithi053.stdout:231928234030 2024-09-15T03:30:22.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[15077]: cluster 2024-09-15T03:30:21.041818+0000 mgr.y (mgr.24494) 105 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:22.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[15077]: audit 2024-09-15T03:30:21.524792+0000 mon.a (mon.0) 1210 : audit [DBG] from='client.? 172.21.15.53:0/355452572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T03:30:22.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[15077]: audit 2024-09-15T03:30:21.596768+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.53:0/1320208969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T03:30:22.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[15077]: audit 2024-09-15T03:30:21.766914+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.53:0/3762735497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T03:30:22.375 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[21662]: cluster 2024-09-15T03:30:21.041818+0000 mgr.y (mgr.24494) 105 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:22.375 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[21662]: audit 2024-09-15T03:30:21.524792+0000 mon.a (mon.0) 1210 : audit [DBG] from='client.? 172.21.15.53:0/355452572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T03:30:22.375 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[21662]: audit 2024-09-15T03:30:21.596768+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.53:0/1320208969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T03:30:22.375 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[21662]: audit 2024-09-15T03:30:21.766914+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.53:0/3762735497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T03:30:22.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:22 smithi104 bash[15781]: cluster 2024-09-15T03:30:21.041818+0000 mgr.y (mgr.24494) 105 : cluster [DBG] pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:22.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:22 smithi104 bash[15781]: audit 2024-09-15T03:30:21.524792+0000 mon.a (mon.0) 1210 : audit [DBG] from='client.? 172.21.15.53:0/355452572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T03:30:22.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:22 smithi104 bash[15781]: audit 2024-09-15T03:30:21.596768+0000 mon.c (mon.2) 19 : audit [DBG] from='client.? 172.21.15.53:0/1320208969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T03:30:22.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:22 smithi104 bash[15781]: audit 2024-09-15T03:30:21.766914+0000 mon.a (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.53:0/3762735497' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T03:30:23.191 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:30:22 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:22] "GET /metrics HTTP/1.1" 200 219633 "" "Prometheus/2.43.0" 2024-09-15T03:30:23.513 INFO:teuthology.orchestra.run.smithi053.stdout:197568495674 2024-09-15T03:30:24.019 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411429 got 77309411432 for osd.2 2024-09-15T03:30:24.019 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:24.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:24 smithi053 bash[15077]: cluster 2024-09-15T03:30:23.042651+0000 mgr.y (mgr.24494) 106 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:24.406 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:24 smithi053 bash[15077]: audit 2024-09-15T03:30:23.511857+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.53:0/286823658' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T03:30:24.406 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:24 smithi053 bash[21662]: cluster 2024-09-15T03:30:23.042651+0000 mgr.y (mgr.24494) 106 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:24.406 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:24 smithi053 bash[21662]: audit 2024-09-15T03:30:23.511857+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.53:0/286823658' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T03:30:24.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:24 smithi104 bash[15781]: cluster 2024-09-15T03:30:23.042651+0000 mgr.y (mgr.24494) 106 : cluster [DBG] pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:24.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:24 smithi104 bash[15781]: audit 2024-09-15T03:30:23.511857+0000 mon.c (mon.2) 20 : audit [DBG] from='client.? 172.21.15.53:0/286823658' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T03:30:24.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:30:24 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:30:24.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234026 got 231928234030 for osd.7 2024-09-15T03:30:24.650 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:25.269 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738490 got 34359738494 for osd.0 2024-09-15T03:30:25.269 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:26.264 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495669 got 197568495674 for osd.6 2024-09-15T03:30:26.264 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:26.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:26 smithi053 bash[15077]: cluster 2024-09-15T03:30:25.043322+0000 mgr.y (mgr.24494) 107 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:26.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:26 smithi053 bash[21662]: cluster 2024-09-15T03:30:25.043322+0000 mgr.y (mgr.24494) 107 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:26.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:26 smithi104 bash[15781]: cluster 2024-09-15T03:30:25.043322+0000 mgr.y (mgr.24494) 107 : cluster [DBG] pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:27.903 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:27 smithi104 bash[15781]: audit 2024-09-15T03:30:26.584999+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.903 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:27 smithi104 bash[15781]: audit 2024-09-15T03:30:26.590442+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.903 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:27 smithi104 bash[15781]: audit 2024-09-15T03:30:26.595582+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.903 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:27 smithi104 bash[15781]: cluster 2024-09-15T03:30:27.043933+0000 mgr.y (mgr.24494) 108 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:30:27.903 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:27 smithi104 bash[15781]: audit 2024-09-15T03:30:27.089567+0000 mon.a (mon.0) 1215 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[15077]: audit 2024-09-15T03:30:26.584999+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[15077]: audit 2024-09-15T03:30:26.590442+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[15077]: audit 2024-09-15T03:30:26.595582+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[15077]: cluster 2024-09-15T03:30:27.043933+0000 mgr.y (mgr.24494) 108 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:30:27.941 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[15077]: audit 2024-09-15T03:30:27.089567+0000 mon.a (mon.0) 1215 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:27.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[21662]: audit 2024-09-15T03:30:26.584999+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.941 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[21662]: audit 2024-09-15T03:30:26.590442+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[21662]: audit 2024-09-15T03:30:26.595582+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:27.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[21662]: cluster 2024-09-15T03:30:27.043933+0000 mgr.y (mgr.24494) 108 : cluster [DBG] pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:30:27.942 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:27 smithi053 bash[21662]: audit 2024-09-15T03:30:27.089567+0000 mon.a (mon.0) 1215 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:28.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:30:28 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:30:29.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[15077]: audit 2024-09-15T03:30:27.885297+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[15077]: audit 2024-09-15T03:30:27.892471+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[15077]: audit 2024-09-15T03:30:27.899265+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[15077]: audit 2024-09-15T03:30:28.110469+0000 mgr.y (mgr.24494) 109 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:29.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[21662]: audit 2024-09-15T03:30:27.885297+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[21662]: audit 2024-09-15T03:30:27.892471+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[21662]: audit 2024-09-15T03:30:27.899265+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.192 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:28 smithi053 bash[21662]: audit 2024-09-15T03:30:28.110469+0000 mgr.y (mgr.24494) 109 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:29.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:28 smithi104 bash[15781]: audit 2024-09-15T03:30:27.885297+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:28 smithi104 bash[15781]: audit 2024-09-15T03:30:27.892471+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:28 smithi104 bash[15781]: audit 2024-09-15T03:30:27.899265+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:29.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:28 smithi104 bash[15781]: audit 2024-09-15T03:30:28.110469+0000 mgr.y (mgr.24494) 109 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:29.333 INFO:teuthology.orchestra.run.smithi053.stdout:128849018962 2024-09-15T03:30:29.672 INFO:teuthology.orchestra.run.smithi053.stdout:107374182494 2024-09-15T03:30:29.853 INFO:teuthology.orchestra.run.smithi053.stdout:163208757318 2024-09-15T03:30:30.037 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[21662]: cluster 2024-09-15T03:30:29.045339+0000 mgr.y (mgr.24494) 110 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:30.037 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[21662]: audit 2024-09-15T03:30:29.330974+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.15.53:0/2603508901' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T03:30:30.037 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[21662]: audit 2024-09-15T03:30:29.670492+0000 mon.a (mon.0) 1220 : audit [DBG] from='client.? 172.21.15.53:0/1537024525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T03:30:30.037 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[21662]: audit 2024-09-15T03:30:29.851685+0000 mon.a (mon.0) 1221 : audit [DBG] from='client.? 172.21.15.53:0/2933252343' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T03:30:30.038 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[15077]: cluster 2024-09-15T03:30:29.045339+0000 mgr.y (mgr.24494) 110 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:30.038 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[15077]: audit 2024-09-15T03:30:29.330974+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.15.53:0/2603508901' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T03:30:30.038 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[15077]: audit 2024-09-15T03:30:29.670492+0000 mon.a (mon.0) 1220 : audit [DBG] from='client.? 172.21.15.53:0/1537024525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T03:30:30.038 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:29 smithi053 bash[15077]: audit 2024-09-15T03:30:29.851685+0000 mon.a (mon.0) 1221 : audit [DBG] from='client.? 172.21.15.53:0/2933252343' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T03:30:30.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:29 smithi104 bash[15781]: cluster 2024-09-15T03:30:29.045339+0000 mgr.y (mgr.24494) 110 : cluster [DBG] pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:30.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:29 smithi104 bash[15781]: audit 2024-09-15T03:30:29.330974+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.15.53:0/2603508901' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T03:30:30.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:29 smithi104 bash[15781]: audit 2024-09-15T03:30:29.670492+0000 mon.a (mon.0) 1220 : audit [DBG] from='client.? 172.21.15.53:0/1537024525' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T03:30:30.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:29 smithi104 bash[15781]: audit 2024-09-15T03:30:29.851685+0000 mon.a (mon.0) 1221 : audit [DBG] from='client.? 172.21.15.53:0/2933252343' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T03:30:30.855 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018958 got 128849018962 for osd.4 2024-09-15T03:30:30.855 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[21662]: audit 2024-09-15T03:30:30.784359+0000 mon.a (mon.0) 1222 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:30:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[21662]: audit 2024-09-15T03:30:30.788237+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:30:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[21662]: audit 2024-09-15T03:30:30.789712+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:30:31.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[21662]: audit 2024-09-15T03:30:30.798419+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[15077]: audit 2024-09-15T03:30:30.784359+0000 mon.a (mon.0) 1222 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:30:31.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[15077]: audit 2024-09-15T03:30:30.788237+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:30:31.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[15077]: audit 2024-09-15T03:30:30.789712+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:30:31.192 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:30 smithi053 bash[15077]: audit 2024-09-15T03:30:30.798419+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:31.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:30 smithi104 bash[15781]: audit 2024-09-15T03:30:30.784359+0000 mon.a (mon.0) 1222 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:30:31.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:30 smithi104 bash[15781]: audit 2024-09-15T03:30:30.788237+0000 mon.a (mon.0) 1223 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:30:31.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:30 smithi104 bash[15781]: audit 2024-09-15T03:30:30.789712+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:30:31.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:30 smithi104 bash[15781]: audit 2024-09-15T03:30:30.798419+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:31.772 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182490 got 107374182494 for osd.3 2024-09-15T03:30:31.772 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:31.789 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757314 got 163208757318 for osd.5 2024-09-15T03:30:31.789 DEBUG:teuthology.parallel:result is None 2024-09-15T03:30:31.790 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T03:30:31.790 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T03:30:32.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:31 smithi053 bash[21662]: cluster 2024-09-15T03:30:31.046034+0000 mgr.y (mgr.24494) 111 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:32.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:31 smithi053 bash[15077]: cluster 2024-09-15T03:30:31.046034+0000 mgr.y (mgr.24494) 111 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:32.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:31 smithi104 bash[15781]: cluster 2024-09-15T03:30:31.046034+0000 mgr.y (mgr.24494) 111 : cluster [DBG] pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:33.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:30:32 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:32] "GET /metrics HTTP/1.1" 200 219629 "" "Prometheus/2.43.0" 2024-09-15T03:30:34.104 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:30:34 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:34] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:30:34.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:34 smithi053 bash[21662]: cluster 2024-09-15T03:30:33.047058+0000 mgr.y (mgr.24494) 112 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:34.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:34 smithi053 bash[15077]: cluster 2024-09-15T03:30:33.047058+0000 mgr.y (mgr.24494) 112 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:34.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:34 smithi104 bash[15781]: cluster 2024-09-15T03:30:33.047058+0000 mgr.y (mgr.24494) 112 : cluster [DBG] pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:36.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:36 smithi053 bash[21662]: cluster 2024-09-15T03:30:35.047748+0000 mgr.y (mgr.24494) 113 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:36.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:36 smithi053 bash[15077]: cluster 2024-09-15T03:30:35.047748+0000 mgr.y (mgr.24494) 113 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:36.484 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:36 smithi104 bash[15781]: cluster 2024-09-15T03:30:35.047748+0000 mgr.y (mgr.24494) 113 : cluster [DBG] pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:36.980 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:38.374 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:38 smithi053 bash[21662]: cluster 2024-09-15T03:30:37.048470+0000 mgr.y (mgr.24494) 114 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:38.374 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:38 smithi053 bash[15077]: cluster 2024-09-15T03:30:37.048470+0000 mgr.y (mgr.24494) 114 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:38.475 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:30:38 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:30:38.475 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:38 smithi104 bash[15781]: cluster 2024-09-15T03:30:37.048470+0000 mgr.y (mgr.24494) 114 : cluster [DBG] pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:39.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:39 smithi053 bash[21662]: audit 2024-09-15T03:30:38.119040+0000 mgr.y (mgr.24494) 115 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:39 smithi053 bash[15077]: audit 2024-09-15T03:30:38.119040+0000 mgr.y (mgr.24494) 115 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:39.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:39 smithi104 bash[15781]: audit 2024-09-15T03:30:38.119040+0000 mgr.y (mgr.24494) 115 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:40.412 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:30:40.414 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-15T03:30:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:40 smithi053 bash[21662]: cluster 2024-09-15T03:30:39.049320+0000 mgr.y (mgr.24494) 116 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:40 smithi053 bash[15077]: cluster 2024-09-15T03:30:39.049320+0000 mgr.y (mgr.24494) 116 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:40.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:40 smithi104 bash[15781]: cluster 2024-09-15T03:30:39.049320+0000 mgr.y (mgr.24494) 116 : cluster [DBG] pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:41.148 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-15T03:30:39.048724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596188,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1452,"num_read_kb":1273,"num_write":801,"num_write_kb":3237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":829,"ondisk_log_size":829,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749928448,"kb_used":2387056,"kb_used_data":8216,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":747541392,"statfs":{"total":767926730752,"available":765482385408,"internally_reserved":0,"allocated":8413184,"data_stored":4585521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005116"},"pg_stats":[{"pgid":"6.1b","version":"67'1","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407639+0000","last_change":"2024-09-15T03:27:31.124391+0000","last_active":"2024-09-15T03:28:05.407639+0000","last_peered":"2024-09-15T03:28:05.407639+0000","last_clean":"2024-09-15T03:28:05.407639+0000","last_became_active":"2024-09-15T03:27:31.123975+0000","last_became_peered":"2024-09-15T03:27:31.123975+0000","last_unstale":"2024-09-15T03:28:05.407639+0000","last_undegraded":"2024-09-15T03:28:05.407639+0000","last_fullsized":"2024-09-15T03:28:05.407639+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:57:12.231753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988372+0000","last_change":"2024-09-15T03:27:24.387137+0000","last_active":"2024-09-15T03:28:05.988372+0000","last_peered":"2024-09-15T03:28:05.988372+0000","last_clean":"2024-09-15T03:28:05.988372+0000","last_became_active":"2024-09-15T03:27:24.386535+0000","last_became_peered":"2024-09-15T03:27:24.386535+0000","last_unstale":"2024-09-15T03:28:05.988372+0000","last_undegraded":"2024-09-15T03:28:05.988372+0000","last_fullsized":"2024-09-15T03:28:05.988372+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:24:20.029808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'16","reported_seq":51,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408147+0000","last_change":"2024-09-15T03:27:26.657498+0000","last_active":"2024-09-15T03:28:05.408147+0000","last_peered":"2024-09-15T03:28:05.408147+0000","last_clean":"2024-09-15T03:28:05.408147+0000","last_became_active":"2024-09-15T03:27:26.657099+0000","last_became_peered":"2024-09-15T03:27:26.657099+0000","last_unstale":"2024-09-15T03:28:05.408147+0000","last_undegraded":"2024-09-15T03:28:05.408147+0000","last_fullsized":"2024-09-15T03:28:05.408147+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:57:09.115026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407693+0000","last_change":"2024-09-15T03:27:28.533310+0000","last_active":"2024-09-15T03:28:05.407693+0000","last_peered":"2024-09-15T03:28:05.407693+0000","last_clean":"2024-09-15T03:28:05.407693+0000","last_became_active":"2024-09-15T03:27:28.532419+0000","last_became_peered":"2024-09-15T03:27:28.532419+0000","last_unstale":"2024-09-15T03:28:05.407693+0000","last_undegraded":"2024-09-15T03:28:05.407693+0000","last_fullsized":"2024-09-15T03:28:05.407693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:05:13.543627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408253+0000","last_change":"2024-09-15T03:27:24.384624+0000","last_active":"2024-09-15T03:28:05.408253+0000","last_peered":"2024-09-15T03:28:05.408253+0000","last_clean":"2024-09-15T03:28:05.408253+0000","last_became_active":"2024-09-15T03:27:24.384320+0000","last_became_peered":"2024-09-15T03:27:24.384320+0000","last_unstale":"2024-09-15T03:28:05.408253+0000","last_undegraded":"2024-09-15T03:28:05.408253+0000","last_fullsized":"2024-09-15T03:28:05.408253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:43.173507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'17","reported_seq":55,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988171+0000","last_change":"2024-09-15T03:27:26.653991+0000","last_active":"2024-09-15T03:28:05.988171+0000","last_peered":"2024-09-15T03:28:05.988171+0000","last_clean":"2024-09-15T03:28:05.988171+0000","last_became_active":"2024-09-15T03:27:26.653604+0000","last_became_peered":"2024-09-15T03:27:26.653604+0000","last_unstale":"2024-09-15T03:28:05.988171+0000","last_undegraded":"2024-09-15T03:28:05.988171+0000","last_fullsized":"2024-09-15T03:28:05.988171+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:08:30.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401603+0000","last_change":"2024-09-15T03:27:28.526746+0000","last_active":"2024-09-15T03:28:05.401603+0000","last_peered":"2024-09-15T03:28:05.401603+0000","last_clean":"2024-09-15T03:28:05.401603+0000","last_became_active":"2024-09-15T03:27:28.526416+0000","last_became_peered":"2024-09-15T03:27:28.526416+0000","last_unstale":"2024-09-15T03:28:05.401603+0000","last_undegraded":"2024-09-15T03:28:05.401603+0000","last_fullsized":"2024-09-15T03:28:05.401603+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:07:16.364725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401645+0000","last_change":"2024-09-15T03:27:30.553726+0000","last_active":"2024-09-15T03:28:05.401645+0000","last_peered":"2024-09-15T03:28:05.401645+0000","last_clean":"2024-09-15T03:28:05.401645+0000","last_became_active":"2024-09-15T03:27:30.553357+0000","last_became_peered":"2024-09-15T03:27:30.553357+0000","last_unstale":"2024-09-15T03:28:05.401645+0000","last_undegraded":"2024-09-15T03:28:05.401645+0000","last_fullsized":"2024-09-15T03:28:05.401645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:47:00.932589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985647+0000","last_change":"2024-09-15T03:27:24.386635+0000","last_active":"2024-09-15T03:28:05.985647+0000","last_peered":"2024-09-15T03:28:05.985647+0000","last_clean":"2024-09-15T03:28:05.985647+0000","last_became_active":"2024-09-15T03:27:24.386334+0000","last_became_peered":"2024-09-15T03:27:24.386334+0000","last_unstale":"2024-09-15T03:28:05.985647+0000","last_undegraded":"2024-09-15T03:28:05.985647+0000","last_fullsized":"2024-09-15T03:28:05.985647+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:00:15.816788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":46,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405794+0000","last_change":"2024-09-15T03:27:26.395477+0000","last_active":"2024-09-15T03:28:05.405794+0000","last_peered":"2024-09-15T03:28:05.405794+0000","last_clean":"2024-09-15T03:28:05.405794+0000","last_became_active":"2024-09-15T03:27:26.395073+0000","last_became_peered":"2024-09-15T03:27:26.395073+0000","last_unstale":"2024-09-15T03:28:05.405794+0000","last_undegraded":"2024-09-15T03:28:05.405794+0000","last_fullsized":"2024-09-15T03:28:05.405794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:32:21.977219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402049+0000","last_change":"2024-09-15T03:27:28.524089+0000","last_active":"2024-09-15T03:28:05.402049+0000","last_peered":"2024-09-15T03:28:05.402049+0000","last_clean":"2024-09-15T03:28:05.402049+0000","last_became_active":"2024-09-15T03:27:28.523748+0000","last_became_peered":"2024-09-15T03:27:28.523748+0000","last_unstale":"2024-09-15T03:28:05.402049+0000","last_undegraded":"2024-09-15T03:28:05.402049+0000","last_fullsized":"2024-09-15T03:28:05.402049+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:43:02.313736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405318+0000","last_change":"2024-09-15T03:27:30.559494+0000","last_active":"2024-09-15T03:28:05.405318+0000","last_peered":"2024-09-15T03:28:05.405318+0000","last_clean":"2024-09-15T03:28:05.405318+0000","last_became_active":"2024-09-15T03:27:30.559097+0000","last_became_peered":"2024-09-15T03:27:30.559097+0000","last_unstale":"2024-09-15T03:28:05.405318+0000","last_undegraded":"2024-09-15T03:28:05.405318+0000","last_fullsized":"2024-09-15T03:28:05.405318+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:52:14.678175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985737+0000","last_change":"2024-09-15T03:27:24.385619+0000","last_active":"2024-09-15T03:28:05.985737+0000","last_peered":"2024-09-15T03:28:05.985737+0000","last_clean":"2024-09-15T03:28:05.985737+0000","last_became_active":"2024-09-15T03:27:24.385309+0000","last_became_peered":"2024-09-15T03:27:24.385309+0000","last_unstale":"2024-09-15T03:28:05.985737+0000","last_undegraded":"2024-09-15T03:28:05.985737+0000","last_fullsized":"2024-09-15T03:28:05.985737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:59:20.001150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'18","reported_seq":59,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406300+0000","last_change":"2024-09-15T03:27:26.394989+0000","last_active":"2024-09-15T03:28:05.406300+0000","last_peered":"2024-09-15T03:28:05.406300+0000","last_clean":"2024-09-15T03:28:05.406300+0000","last_became_active":"2024-09-15T03:27:26.394559+0000","last_became_peered":"2024-09-15T03:27:26.394559+0000","last_unstale":"2024-09-15T03:28:05.406300+0000","last_undegraded":"2024-09-15T03:28:05.406300+0000","last_fullsized":"2024-09-15T03:28:05.406300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:42:40.184469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401968+0000","last_change":"2024-09-15T03:27:28.529771+0000","last_active":"2024-09-15T03:28:05.401968+0000","last_peered":"2024-09-15T03:28:05.401968+0000","last_clean":"2024-09-15T03:28:05.401968+0000","last_became_active":"2024-09-15T03:27:28.529441+0000","last_became_peered":"2024-09-15T03:27:28.529441+0000","last_unstale":"2024-09-15T03:28:05.401968+0000","last_undegraded":"2024-09-15T03:28:05.401968+0000","last_fullsized":"2024-09-15T03:28:05.401968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:20:26.397510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987297+0000","last_change":"2024-09-15T03:27:30.553374+0000","last_active":"2024-09-15T03:28:05.987297+0000","last_peered":"2024-09-15T03:28:05.987297+0000","last_clean":"2024-09-15T03:28:05.987297+0000","last_became_active":"2024-09-15T03:27:30.552838+0000","last_became_peered":"2024-09-15T03:27:30.552838+0000","last_unstale":"2024-09-15T03:28:05.987297+0000","last_undegraded":"2024-09-15T03:28:05.987297+0000","last_fullsized":"2024-09-15T03:28:05.987297+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:38:54.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"67'25","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399178+0000","last_change":"2024-09-15T03:27:26.392755+0000","last_active":"2024-09-15T03:28:05.399178+0000","last_peered":"2024-09-15T03:28:05.399178+0000","last_clean":"2024-09-15T03:28:05.399178+0000","last_became_active":"2024-09-15T03:27:26.392476+0000","last_became_peered":"2024-09-15T03:27:26.392476+0000","last_unstale":"2024-09-15T03:28:05.399178+0000","last_undegraded":"2024-09-15T03:28:05.399178+0000","last_fullsized":"2024-09-15T03:28:05.399178+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:10:43.926169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":32,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985176+0000","last_change":"2024-09-15T03:27:24.385608+0000","last_active":"2024-09-15T03:28:05.985176+0000","last_peered":"2024-09-15T03:28:05.985176+0000","last_clean":"2024-09-15T03:28:05.985176+0000","last_became_active":"2024-09-15T03:27:24.385291+0000","last_became_peered":"2024-09-15T03:27:24.385291+0000","last_unstale":"2024-09-15T03:28:05.985176+0000","last_undegraded":"2024-09-15T03:28:05.985176+0000","last_fullsized":"2024-09-15T03:28:05.985176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:11:10.847992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"67'11","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.490733+0000","last_change":"2024-09-15T03:27:28.523932+0000","last_active":"2024-09-15T03:30:29.490733+0000","last_peered":"2024-09-15T03:30:29.490733+0000","last_clean":"2024-09-15T03:30:29.490733+0000","last_became_active":"2024-09-15T03:27:28.523628+0000","last_became_peered":"2024-09-15T03:27:28.523628+0000","last_unstale":"2024-09-15T03:30:29.490733+0000","last_undegraded":"2024-09-15T03:30:29.490733+0000","last_fullsized":"2024-09-15T03:30:29.490733+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:06:42.917795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405547+0000","last_change":"2024-09-15T03:27:30.560035+0000","last_active":"2024-09-15T03:28:05.405547+0000","last_peered":"2024-09-15T03:28:05.405547+0000","last_clean":"2024-09-15T03:28:05.405547+0000","last_became_active":"2024-09-15T03:27:30.559732+0000","last_became_peered":"2024-09-15T03:27:30.559732+0000","last_unstale":"2024-09-15T03:28:05.405547+0000","last_undegraded":"2024-09-15T03:28:05.405547+0000","last_fullsized":"2024-09-15T03:28:05.405547+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:25:25.073992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"67'15","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408243+0000","last_change":"2024-09-15T03:27:26.400699+0000","last_active":"2024-09-15T03:28:05.408243+0000","last_peered":"2024-09-15T03:28:05.408243+0000","last_clean":"2024-09-15T03:28:05.408243+0000","last_became_active":"2024-09-15T03:27:26.399984+0000","last_became_peered":"2024-09-15T03:27:26.399984+0000","last_unstale":"2024-09-15T03:28:05.408243+0000","last_undegraded":"2024-09-15T03:28:05.408243+0000","last_fullsized":"2024-09-15T03:28:05.408243+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:19:16.096839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402601+0000","last_change":"2024-09-15T03:27:24.389141+0000","last_active":"2024-09-15T03:28:05.402601+0000","last_peered":"2024-09-15T03:28:05.402601+0000","last_clean":"2024-09-15T03:28:05.402601+0000","last_became_active":"2024-09-15T03:27:24.388778+0000","last_became_peered":"2024-09-15T03:27:24.388778+0000","last_unstale":"2024-09-15T03:28:05.402601+0000","last_undegraded":"2024-09-15T03:28:05.402601+0000","last_fullsized":"2024-09-15T03:28:05.402601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:15:29.733096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402150+0000","last_change":"2024-09-15T03:27:28.530550+0000","last_active":"2024-09-15T03:28:05.402150+0000","last_peered":"2024-09-15T03:28:05.402150+0000","last_clean":"2024-09-15T03:28:05.402150+0000","last_became_active":"2024-09-15T03:27:28.530243+0000","last_became_peered":"2024-09-15T03:27:28.530243+0000","last_unstale":"2024-09-15T03:28:05.402150+0000","last_undegraded":"2024-09-15T03:28:05.402150+0000","last_fullsized":"2024-09-15T03:28:05.402150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:52:56.099120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402726+0000","last_change":"2024-09-15T03:27:30.554189+0000","last_active":"2024-09-15T03:28:05.402726+0000","last_peered":"2024-09-15T03:28:05.402726+0000","last_clean":"2024-09-15T03:28:05.402726+0000","last_became_active":"2024-09-15T03:27:30.553819+0000","last_became_peered":"2024-09-15T03:27:30.553819+0000","last_unstale":"2024-09-15T03:28:05.402726+0000","last_undegraded":"2024-09-15T03:28:05.402726+0000","last_fullsized":"2024-09-15T03:28:05.402726+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:01:13.881192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"67'27","reported_seq":76,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407868+0000","last_change":"2024-09-15T03:27:26.397091+0000","last_active":"2024-09-15T03:28:05.407868+0000","last_peered":"2024-09-15T03:28:05.407868+0000","last_clean":"2024-09-15T03:28:05.407868+0000","last_became_active":"2024-09-15T03:27:26.396728+0000","last_became_peered":"2024-09-15T03:27:26.396728+0000","last_unstale":"2024-09-15T03:28:05.407868+0000","last_undegraded":"2024-09-15T03:28:05.407868+0000","last_fullsized":"2024-09-15T03:28:05.407868+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:26:41.980014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401443+0000","last_change":"2024-09-15T03:27:24.388121+0000","last_active":"2024-09-15T03:28:05.401443+0000","last_peered":"2024-09-15T03:28:05.401443+0000","last_clean":"2024-09-15T03:28:05.401443+0000","last_became_active":"2024-09-15T03:27:24.387642+0000","last_became_peered":"2024-09-15T03:27:24.387642+0000","last_unstale":"2024-09-15T03:28:05.401443+0000","last_undegraded":"2024-09-15T03:28:05.401443+0000","last_fullsized":"2024-09-15T03:28:05.401443+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:01:37.490431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403424+0000","last_change":"2024-09-15T03:27:28.525766+0000","last_active":"2024-09-15T03:28:05.403424+0000","last_peered":"2024-09-15T03:28:05.403424+0000","last_clean":"2024-09-15T03:28:05.403424+0000","last_became_active":"2024-09-15T03:27:28.525481+0000","last_became_peered":"2024-09-15T03:27:28.525481+0000","last_unstale":"2024-09-15T03:28:05.403424+0000","last_undegraded":"2024-09-15T03:28:05.403424+0000","last_fullsized":"2024-09-15T03:28:05.403424+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:00:35.641647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405790+0000","last_change":"2024-09-15T03:27:30.559421+0000","last_active":"2024-09-15T03:28:05.405790+0000","last_peered":"2024-09-15T03:28:05.405790+0000","last_clean":"2024-09-15T03:28:05.405790+0000","last_became_active":"2024-09-15T03:27:30.559047+0000","last_became_peered":"2024-09-15T03:27:30.559047+0000","last_unstale":"2024-09-15T03:28:05.405790+0000","last_undegraded":"2024-09-15T03:28:05.405790+0000","last_fullsized":"2024-09-15T03:28:05.405790+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:09:12.644729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"67'24","reported_seq":74,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403118+0000","last_change":"2024-09-15T03:27:26.653270+0000","last_active":"2024-09-15T03:28:05.403118+0000","last_peered":"2024-09-15T03:28:05.403118+0000","last_clean":"2024-09-15T03:28:05.403118+0000","last_became_active":"2024-09-15T03:27:26.652480+0000","last_became_peered":"2024-09-15T03:27:26.652480+0000","last_unstale":"2024-09-15T03:28:05.403118+0000","last_undegraded":"2024-09-15T03:28:05.403118+0000","last_fullsized":"2024-09-15T03:28:05.403118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:40:15.477478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":38,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.986008+0000","last_change":"2024-09-15T03:27:24.388200+0000","last_active":"2024-09-15T03:28:05.986008+0000","last_peered":"2024-09-15T03:28:05.986008+0000","last_clean":"2024-09-15T03:28:05.986008+0000","last_became_active":"2024-09-15T03:27:24.387872+0000","last_became_peered":"2024-09-15T03:27:24.387872+0000","last_unstale":"2024-09-15T03:28:05.986008+0000","last_undegraded":"2024-09-15T03:28:05.986008+0000","last_fullsized":"2024-09-15T03:28:05.986008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:53:05.679841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"67'11","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.490801+0000","last_change":"2024-09-15T03:27:28.526874+0000","last_active":"2024-09-15T03:30:29.490801+0000","last_peered":"2024-09-15T03:30:29.490801+0000","last_clean":"2024-09-15T03:30:29.490801+0000","last_became_active":"2024-09-15T03:27:28.526590+0000","last_became_peered":"2024-09-15T03:27:28.526590+0000","last_unstale":"2024-09-15T03:30:29.490801+0000","last_undegraded":"2024-09-15T03:30:29.490801+0000","last_fullsized":"2024-09-15T03:30:29.490801+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:29:38.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407634+0000","last_change":"2024-09-15T03:27:31.123291+0000","last_active":"2024-09-15T03:28:05.407634+0000","last_peered":"2024-09-15T03:28:05.407634+0000","last_clean":"2024-09-15T03:28:05.407634+0000","last_became_active":"2024-09-15T03:27:31.122569+0000","last_became_peered":"2024-09-15T03:27:31.122569+0000","last_unstale":"2024-09-15T03:28:05.407634+0000","last_undegraded":"2024-09-15T03:28:05.407634+0000","last_fullsized":"2024-09-15T03:28:05.407634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:35:21.274687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988120+0000","last_change":"2024-09-15T03:27:26.399381+0000","last_active":"2024-09-15T03:28:05.988120+0000","last_peered":"2024-09-15T03:28:05.988120+0000","last_clean":"2024-09-15T03:28:05.988120+0000","last_became_active":"2024-09-15T03:27:26.399011+0000","last_became_peered":"2024-09-15T03:27:26.399011+0000","last_unstale":"2024-09-15T03:28:05.988120+0000","last_undegraded":"2024-09-15T03:28:05.988120+0000","last_fullsized":"2024-09-15T03:28:05.988120+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:53:27.461679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.400348+0000","last_change":"2024-09-15T03:27:24.385809+0000","last_active":"2024-09-15T03:28:05.400348+0000","last_peered":"2024-09-15T03:28:05.400348+0000","last_clean":"2024-09-15T03:28:05.400348+0000","last_became_active":"2024-09-15T03:27:24.385427+0000","last_became_peered":"2024-09-15T03:27:24.385427+0000","last_unstale":"2024-09-15T03:28:05.400348+0000","last_undegraded":"2024-09-15T03:28:05.400348+0000","last_fullsized":"2024-09-15T03:28:05.400348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:00:16.899371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402957+0000","last_change":"2024-09-15T03:27:28.531584+0000","last_active":"2024-09-15T03:28:05.402957+0000","last_peered":"2024-09-15T03:28:05.402957+0000","last_clean":"2024-09-15T03:28:05.402957+0000","last_became_active":"2024-09-15T03:27:28.531141+0000","last_became_peered":"2024-09-15T03:27:28.531141+0000","last_unstale":"2024-09-15T03:28:05.402957+0000","last_undegraded":"2024-09-15T03:28:05.402957+0000","last_fullsized":"2024-09-15T03:28:05.402957+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:18:40.153533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"71'5","reported_seq":192,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:36.010850+0000","last_change":"2024-09-15T03:27:40.423193+0000","last_active":"2024-09-15T03:30:36.010850+0000","last_peered":"2024-09-15T03:30:36.010850+0000","last_clean":"2024-09-15T03:30:36.010850+0000","last_became_active":"2024-09-15T03:27:29.549624+0000","last_became_peered":"2024-09-15T03:27:29.549624+0000","last_unstale":"2024-09-15T03:30:36.010850+0000","last_undegraded":"2024-09-15T03:30:36.010850+0000","last_fullsized":"2024-09-15T03:30:36.010850+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_clean_scrub_stamp":"2024-09-15T03:27:28.501254+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:42:16.242706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085985499999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":166,"num_read_kb":161,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984722+0000","last_change":"2024-09-15T03:27:31.121765+0000","last_active":"2024-09-15T03:28:05.984722+0000","last_peered":"2024-09-15T03:28:05.984722+0000","last_clean":"2024-09-15T03:28:05.984722+0000","last_became_active":"2024-09-15T03:27:31.121174+0000","last_became_peered":"2024-09-15T03:27:31.121174+0000","last_unstale":"2024-09-15T03:28:05.984722+0000","last_undegraded":"2024-09-15T03:28:05.984722+0000","last_fullsized":"2024-09-15T03:28:05.984722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:11:02.715916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"67'19","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408442+0000","last_change":"2024-09-15T03:27:26.402846+0000","last_active":"2024-09-15T03:28:05.408442+0000","last_peered":"2024-09-15T03:28:05.408442+0000","last_clean":"2024-09-15T03:28:05.408442+0000","last_became_active":"2024-09-15T03:27:26.402527+0000","last_became_peered":"2024-09-15T03:27:26.402527+0000","last_unstale":"2024-09-15T03:28:05.408442+0000","last_undegraded":"2024-09-15T03:28:05.408442+0000","last_fullsized":"2024-09-15T03:28:05.408442+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:54:54.102693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403432+0000","last_change":"2024-09-15T03:27:24.379408+0000","last_active":"2024-09-15T03:28:05.403432+0000","last_peered":"2024-09-15T03:28:05.403432+0000","last_clean":"2024-09-15T03:28:05.403432+0000","last_became_active":"2024-09-15T03:27:24.379062+0000","last_became_peered":"2024-09-15T03:27:24.379062+0000","last_unstale":"2024-09-15T03:28:05.403432+0000","last_undegraded":"2024-09-15T03:28:05.403432+0000","last_fullsized":"2024-09-15T03:28:05.403432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:09:02.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"67'11","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.492932+0000","last_change":"2024-09-15T03:27:28.533775+0000","last_active":"2024-09-15T03:30:29.492932+0000","last_peered":"2024-09-15T03:30:29.492932+0000","last_clean":"2024-09-15T03:30:29.492932+0000","last_became_active":"2024-09-15T03:27:28.532922+0000","last_became_peered":"2024-09-15T03:27:28.532922+0000","last_unstale":"2024-09-15T03:30:29.492932+0000","last_undegraded":"2024-09-15T03:30:29.492932+0000","last_fullsized":"2024-09-15T03:30:29.492932+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:33:56.128086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"68'1","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401746+0000","last_change":"2024-09-15T03:27:40.520355+0000","last_active":"2024-09-15T03:28:05.401746+0000","last_peered":"2024-09-15T03:28:05.401746+0000","last_clean":"2024-09-15T03:28:05.401746+0000","last_became_active":"2024-09-15T03:27:29.549223+0000","last_became_peered":"2024-09-15T03:27:29.549223+0000","last_unstale":"2024-09-15T03:28:05.401746+0000","last_undegraded":"2024-09-15T03:28:05.401746+0000","last_fullsized":"2024-09-15T03:28:05.401746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_clean_scrub_stamp":"2024-09-15T03:27:28.501254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:15:46.241441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014590720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401863+0000","last_change":"2024-09-15T03:27:30.554412+0000","last_active":"2024-09-15T03:28:05.401863+0000","last_peered":"2024-09-15T03:28:05.401863+0000","last_clean":"2024-09-15T03:28:05.401863+0000","last_became_active":"2024-09-15T03:27:30.554055+0000","last_became_peered":"2024-09-15T03:27:30.554055+0000","last_unstale":"2024-09-15T03:28:05.401863+0000","last_undegraded":"2024-09-15T03:28:05.401863+0000","last_fullsized":"2024-09-15T03:28:05.401863+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:33:15.313425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"67'36","reported_seq":126,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.492937+0000","last_change":"2024-09-15T03:27:26.654345+0000","last_active":"2024-09-15T03:30:29.492937+0000","last_peered":"2024-09-15T03:30:29.492937+0000","last_clean":"2024-09-15T03:30:29.492937+0000","last_became_active":"2024-09-15T03:27:26.653831+0000","last_became_peered":"2024-09-15T03:27:26.653831+0000","last_unstale":"2024-09-15T03:30:29.492937+0000","last_undegraded":"2024-09-15T03:30:29.492937+0000","last_fullsized":"2024-09-15T03:30:29.492937+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:50:29.891157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"60'1","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985791+0000","last_change":"2024-09-15T03:27:24.387195+0000","last_active":"2024-09-15T03:28:05.985791+0000","last_peered":"2024-09-15T03:28:05.985791+0000","last_clean":"2024-09-15T03:28:05.985791+0000","last_became_active":"2024-09-15T03:27:24.386841+0000","last_became_peered":"2024-09-15T03:27:24.386841+0000","last_unstale":"2024-09-15T03:28:05.985791+0000","last_undegraded":"2024-09-15T03:28:05.985791+0000","last_fullsized":"2024-09-15T03:28:05.985791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:22:10.723153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"67'11","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.493046+0000","last_change":"2024-09-15T03:27:28.532729+0000","last_active":"2024-09-15T03:30:29.493046+0000","last_peered":"2024-09-15T03:30:29.493046+0000","last_clean":"2024-09-15T03:30:29.493046+0000","last_became_active":"2024-09-15T03:27:28.532419+0000","last_became_peered":"2024-09-15T03:27:28.532419+0000","last_unstale":"2024-09-15T03:30:29.493046+0000","last_undegraded":"2024-09-15T03:30:29.493046+0000","last_fullsized":"2024-09-15T03:30:29.493046+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:41:03.621656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"70'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.398906+0000","last_change":"2024-09-15T03:27:40.194148+0000","last_active":"2024-09-15T03:28:05.398906+0000","last_peered":"2024-09-15T03:28:05.398906+0000","last_clean":"2024-09-15T03:28:05.398906+0000","last_became_active":"2024-09-15T03:27:29.548140+0000","last_became_peered":"2024-09-15T03:27:29.548140+0000","last_unstale":"2024-09-15T03:28:05.398906+0000","last_undegraded":"2024-09-15T03:28:05.398906+0000","last_fullsized":"2024-09-15T03:28:05.398906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_clean_scrub_stamp":"2024-09-15T03:27:28.501254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:18:21.066206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803229999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401031+0000","last_change":"2024-09-15T03:27:31.122766+0000","last_active":"2024-09-15T03:28:05.401031+0000","last_peered":"2024-09-15T03:28:05.401031+0000","last_clean":"2024-09-15T03:28:05.401031+0000","last_became_active":"2024-09-15T03:27:31.122242+0000","last_became_peered":"2024-09-15T03:27:31.122242+0000","last_unstale":"2024-09-15T03:28:05.401031+0000","last_undegraded":"2024-09-15T03:28:05.401031+0000","last_fullsized":"2024-09-15T03:28:05.401031+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:06:32.132362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'14","reported_seq":43,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406317+0000","last_change":"2024-09-15T03:27:26.655557+0000","last_active":"2024-09-15T03:28:05.406317+0000","last_peered":"2024-09-15T03:28:05.406317+0000","last_clean":"2024-09-15T03:28:05.406317+0000","last_became_active":"2024-09-15T03:27:26.655257+0000","last_became_peered":"2024-09-15T03:27:26.655257+0000","last_unstale":"2024-09-15T03:28:05.406317+0000","last_undegraded":"2024-09-15T03:28:05.406317+0000","last_fullsized":"2024-09-15T03:28:05.406317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:29:55.930182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403261+0000","last_change":"2024-09-15T03:27:24.388073+0000","last_active":"2024-09-15T03:28:05.403261+0000","last_peered":"2024-09-15T03:28:05.403261+0000","last_clean":"2024-09-15T03:28:05.403261+0000","last_became_active":"2024-09-15T03:27:24.387718+0000","last_became_peered":"2024-09-15T03:27:24.387718+0000","last_unstale":"2024-09-15T03:28:05.403261+0000","last_undegraded":"2024-09-15T03:28:05.403261+0000","last_fullsized":"2024-09-15T03:28:05.403261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:22:53.283921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401927+0000","last_change":"2024-09-15T03:27:28.525447+0000","last_active":"2024-09-15T03:28:05.401927+0000","last_peered":"2024-09-15T03:28:05.401927+0000","last_clean":"2024-09-15T03:28:05.401927+0000","last_became_active":"2024-09-15T03:27:28.524923+0000","last_became_peered":"2024-09-15T03:27:28.524923+0000","last_unstale":"2024-09-15T03:28:05.401927+0000","last_undegraded":"2024-09-15T03:28:05.401927+0000","last_fullsized":"2024-09-15T03:28:05.401927+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:10:19.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987569+0000","last_change":"2024-09-15T03:27:30.556113+0000","last_active":"2024-09-15T03:28:05.987569+0000","last_peered":"2024-09-15T03:28:05.987569+0000","last_clean":"2024-09-15T03:28:05.987569+0000","last_became_active":"2024-09-15T03:27:30.555690+0000","last_became_peered":"2024-09-15T03:27:30.555690+0000","last_unstale":"2024-09-15T03:28:05.987569+0000","last_undegraded":"2024-09-15T03:28:05.987569+0000","last_fullsized":"2024-09-15T03:28:05.987569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:08:01.262857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"67'25","reported_seq":72,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402758+0000","last_change":"2024-09-15T03:27:26.392182+0000","last_active":"2024-09-15T03:28:05.402758+0000","last_peered":"2024-09-15T03:28:05.402758+0000","last_clean":"2024-09-15T03:28:05.402758+0000","last_became_active":"2024-09-15T03:27:26.391886+0000","last_became_peered":"2024-09-15T03:27:26.391886+0000","last_unstale":"2024-09-15T03:28:05.402758+0000","last_undegraded":"2024-09-15T03:28:05.402758+0000","last_fullsized":"2024-09-15T03:28:05.402758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:03:03.205443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406008+0000","last_change":"2024-09-15T03:27:24.378809+0000","last_active":"2024-09-15T03:28:05.406008+0000","last_peered":"2024-09-15T03:28:05.406008+0000","last_clean":"2024-09-15T03:28:05.406008+0000","last_became_active":"2024-09-15T03:27:24.378511+0000","last_became_peered":"2024-09-15T03:27:24.378511+0000","last_unstale":"2024-09-15T03:28:05.406008+0000","last_undegraded":"2024-09-15T03:28:05.406008+0000","last_fullsized":"2024-09-15T03:28:05.406008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:34:52.049009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402935+0000","last_change":"2024-09-15T03:27:28.526317+0000","last_active":"2024-09-15T03:28:05.402935+0000","last_peered":"2024-09-15T03:28:05.402935+0000","last_clean":"2024-09-15T03:28:05.402935+0000","last_became_active":"2024-09-15T03:27:28.526042+0000","last_became_peered":"2024-09-15T03:27:28.526042+0000","last_unstale":"2024-09-15T03:28:05.402935+0000","last_undegraded":"2024-09-15T03:28:05.402935+0000","last_fullsized":"2024-09-15T03:28:05.402935+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:12:29.259432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407778+0000","last_change":"2024-09-15T03:27:30.558815+0000","last_active":"2024-09-15T03:28:05.407778+0000","last_peered":"2024-09-15T03:28:05.407778+0000","last_clean":"2024-09-15T03:28:05.407778+0000","last_became_active":"2024-09-15T03:27:30.558480+0000","last_became_peered":"2024-09-15T03:27:30.558480+0000","last_unstale":"2024-09-15T03:28:05.407778+0000","last_undegraded":"2024-09-15T03:28:05.407778+0000","last_fullsized":"2024-09-15T03:28:05.407778+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:29:20.980341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"67'30","reported_seq":83,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401045+0000","last_change":"2024-09-15T03:27:26.655549+0000","last_active":"2024-09-15T03:28:05.401045+0000","last_peered":"2024-09-15T03:28:05.401045+0000","last_clean":"2024-09-15T03:28:05.401045+0000","last_became_active":"2024-09-15T03:27:26.654976+0000","last_became_peered":"2024-09-15T03:27:26.654976+0000","last_unstale":"2024-09-15T03:28:05.401045+0000","last_undegraded":"2024-09-15T03:28:05.401045+0000","last_fullsized":"2024-09-15T03:28:05.401045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:07:43.434926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":44,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404824+0000","last_change":"2024-09-15T03:27:24.376072+0000","last_active":"2024-09-15T03:28:05.404824+0000","last_peered":"2024-09-15T03:28:05.404824+0000","last_clean":"2024-09-15T03:28:05.404824+0000","last_became_active":"2024-09-15T03:27:24.375632+0000","last_became_peered":"2024-09-15T03:27:24.375632+0000","last_unstale":"2024-09-15T03:28:05.404824+0000","last_undegraded":"2024-09-15T03:28:05.404824+0000","last_fullsized":"2024-09-15T03:28:05.404824+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:25:13.312604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.991523+0000","last_change":"2024-09-15T03:28:05.990679+0000","last_active":"2024-09-15T03:28:05.991523+0000","last_peered":"2024-09-15T03:28:05.991523+0000","last_clean":"2024-09-15T03:28:05.991523+0000","last_became_active":"2024-09-15T03:28:05.989536+0000","last_became_peered":"2024-09-15T03:28:05.989536+0000","last_unstale":"2024-09-15T03:28:05.991523+0000","last_undegraded":"2024-09-15T03:28:05.991523+0000","last_fullsized":"2024-09-15T03:28:05.991523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:45:13.654223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985136+0000","last_change":"2024-09-15T03:27:31.121897+0000","last_active":"2024-09-15T03:28:05.985136+0000","last_peered":"2024-09-15T03:28:05.985136+0000","last_clean":"2024-09-15T03:28:05.985136+0000","last_became_active":"2024-09-15T03:27:31.121367+0000","last_became_peered":"2024-09-15T03:27:31.121367+0000","last_unstale":"2024-09-15T03:28:05.985136+0000","last_undegraded":"2024-09-15T03:28:05.985136+0000","last_fullsized":"2024-09-15T03:28:05.985136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:12:53.456711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"67'20","reported_seq":57,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987224+0000","last_change":"2024-09-15T03:27:26.399394+0000","last_active":"2024-09-15T03:28:05.987224+0000","last_peered":"2024-09-15T03:28:05.987224+0000","last_clean":"2024-09-15T03:28:05.987224+0000","last_became_active":"2024-09-15T03:27:26.398994+0000","last_became_peered":"2024-09-15T03:27:26.398994+0000","last_unstale":"2024-09-15T03:28:05.987224+0000","last_undegraded":"2024-09-15T03:28:05.987224+0000","last_fullsized":"2024-09-15T03:28:05.987224+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:34:35.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.990930+0000","last_change":"2024-09-15T03:28:05.990054+0000","last_active":"2024-09-15T03:28:05.990930+0000","last_peered":"2024-09-15T03:28:05.990930+0000","last_clean":"2024-09-15T03:28:05.990930+0000","last_became_active":"2024-09-15T03:28:05.989475+0000","last_became_peered":"2024-09-15T03:28:05.989475+0000","last_unstale":"2024-09-15T03:28:05.990930+0000","last_undegraded":"2024-09-15T03:28:05.990930+0000","last_fullsized":"2024-09-15T03:28:05.990930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:20:45.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988098+0000","last_change":"2024-09-15T03:27:28.529994+0000","last_active":"2024-09-15T03:28:05.988098+0000","last_peered":"2024-09-15T03:28:05.988098+0000","last_clean":"2024-09-15T03:28:05.988098+0000","last_became_active":"2024-09-15T03:27:28.529659+0000","last_became_peered":"2024-09-15T03:27:28.529659+0000","last_unstale":"2024-09-15T03:28:05.988098+0000","last_undegraded":"2024-09-15T03:28:05.988098+0000","last_fullsized":"2024-09-15T03:28:05.988098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:15:27.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401213+0000","last_change":"2024-09-15T03:27:30.561436+0000","last_active":"2024-09-15T03:28:05.401213+0000","last_peered":"2024-09-15T03:28:05.401213+0000","last_clean":"2024-09-15T03:28:05.401213+0000","last_became_active":"2024-09-15T03:27:30.560981+0000","last_became_peered":"2024-09-15T03:27:30.560981+0000","last_unstale":"2024-09-15T03:28:05.401213+0000","last_undegraded":"2024-09-15T03:28:05.401213+0000","last_fullsized":"2024-09-15T03:28:05.401213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:08:49.178545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"67'16","reported_seq":51,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407455+0000","last_change":"2024-09-15T03:27:26.396962+0000","last_active":"2024-09-15T03:28:05.407455+0000","last_peered":"2024-09-15T03:28:05.407455+0000","last_clean":"2024-09-15T03:28:05.407455+0000","last_became_active":"2024-09-15T03:27:26.396242+0000","last_became_peered":"2024-09-15T03:27:26.396242+0000","last_unstale":"2024-09-15T03:28:05.407455+0000","last_undegraded":"2024-09-15T03:28:05.407455+0000","last_fullsized":"2024-09-15T03:28:05.407455+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:45:12.136881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405880+0000","last_change":"2024-09-15T03:27:24.384607+0000","last_active":"2024-09-15T03:28:05.405880+0000","last_peered":"2024-09-15T03:28:05.405880+0000","last_clean":"2024-09-15T03:28:05.405880+0000","last_became_active":"2024-09-15T03:27:24.384270+0000","last_became_peered":"2024-09-15T03:27:24.384270+0000","last_unstale":"2024-09-15T03:28:05.405880+0000","last_undegraded":"2024-09-15T03:28:05.405880+0000","last_fullsized":"2024-09-15T03:28:05.405880+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:19:30.643816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"74'139","reported_seq":276,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:28:29.103105+0000","last_change":"2024-09-15T03:26:45.151917+0000","last_active":"2024-09-15T03:28:29.103105+0000","last_peered":"2024-09-15T03:28:29.103105+0000","last_clean":"2024-09-15T03:28:29.103105+0000","last_became_active":"2024-09-15T03:26:45.150693+0000","last_became_peered":"2024-09-15T03:26:45.150693+0000","last_unstale":"2024-09-15T03:28:29.103105+0000","last_undegraded":"2024-09-15T03:28:29.103105+0000","last_fullsized":"2024-09-15T03:28:29.103105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:21:44.219763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:21:44.219763+0000","last_clean_scrub_stamp":"2024-09-15T03:21:44.219763+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:20:32.237730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":258,"num_write":179,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399699+0000","last_change":"2024-09-15T03:27:28.532949+0000","last_active":"2024-09-15T03:28:05.399699+0000","last_peered":"2024-09-15T03:28:05.399699+0000","last_clean":"2024-09-15T03:28:05.399699+0000","last_became_active":"2024-09-15T03:27:28.532658+0000","last_became_peered":"2024-09-15T03:27:28.532658+0000","last_unstale":"2024-09-15T03:28:05.399699+0000","last_undegraded":"2024-09-15T03:28:05.399699+0000","last_fullsized":"2024-09-15T03:28:05.399699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:07:56.259835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406104+0000","last_change":"2024-09-15T03:27:30.558032+0000","last_active":"2024-09-15T03:28:05.406104+0000","last_peered":"2024-09-15T03:28:05.406104+0000","last_clean":"2024-09-15T03:28:05.406104+0000","last_became_active":"2024-09-15T03:27:30.557642+0000","last_became_peered":"2024-09-15T03:27:30.557642+0000","last_unstale":"2024-09-15T03:28:05.406104+0000","last_undegraded":"2024-09-15T03:28:05.406104+0000","last_fullsized":"2024-09-15T03:28:05.406104+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:54:45.242731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":49,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985508+0000","last_change":"2024-09-15T03:27:26.394691+0000","last_active":"2024-09-15T03:28:05.985508+0000","last_peered":"2024-09-15T03:28:05.985508+0000","last_clean":"2024-09-15T03:28:05.985508+0000","last_became_active":"2024-09-15T03:27:26.394222+0000","last_became_peered":"2024-09-15T03:27:26.394222+0000","last_unstale":"2024-09-15T03:28:05.985508+0000","last_undegraded":"2024-09-15T03:28:05.985508+0000","last_fullsized":"2024-09-15T03:28:05.985508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:18:28.297603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405363+0000","last_change":"2024-09-15T03:27:24.385647+0000","last_active":"2024-09-15T03:28:05.405363+0000","last_peered":"2024-09-15T03:28:05.405363+0000","last_clean":"2024-09-15T03:28:05.405363+0000","last_became_active":"2024-09-15T03:27:24.385218+0000","last_became_peered":"2024-09-15T03:27:24.385218+0000","last_unstale":"2024-09-15T03:28:05.405363+0000","last_undegraded":"2024-09-15T03:28:05.405363+0000","last_fullsized":"2024-09-15T03:28:05.405363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:02:09.538720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.398990+0000","last_change":"2024-09-15T03:27:28.529607+0000","last_active":"2024-09-15T03:28:05.398990+0000","last_peered":"2024-09-15T03:28:05.398990+0000","last_clean":"2024-09-15T03:28:05.398990+0000","last_became_active":"2024-09-15T03:27:28.529321+0000","last_became_peered":"2024-09-15T03:27:28.529321+0000","last_unstale":"2024-09-15T03:28:05.398990+0000","last_undegraded":"2024-09-15T03:28:05.398990+0000","last_fullsized":"2024-09-15T03:28:05.398990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:22:47.454093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.986119+0000","last_change":"2024-09-15T03:27:30.552499+0000","last_active":"2024-09-15T03:28:05.986119+0000","last_peered":"2024-09-15T03:28:05.986119+0000","last_clean":"2024-09-15T03:28:05.986119+0000","last_became_active":"2024-09-15T03:27:30.552199+0000","last_became_peered":"2024-09-15T03:27:30.552199+0000","last_unstale":"2024-09-15T03:28:05.986119+0000","last_undegraded":"2024-09-15T03:28:05.986119+0000","last_fullsized":"2024-09-15T03:28:05.986119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:34:53.128751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405899+0000","last_change":"2024-09-15T03:27:26.392459+0000","last_active":"2024-09-15T03:28:05.405899+0000","last_peered":"2024-09-15T03:28:05.405899+0000","last_clean":"2024-09-15T03:28:05.405899+0000","last_became_active":"2024-09-15T03:27:26.391656+0000","last_became_peered":"2024-09-15T03:27:26.391656+0000","last_unstale":"2024-09-15T03:28:05.405899+0000","last_undegraded":"2024-09-15T03:28:05.405899+0000","last_fullsized":"2024-09-15T03:28:05.405899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:28:09.504685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403600+0000","last_change":"2024-09-15T03:27:24.378229+0000","last_active":"2024-09-15T03:28:05.403600+0000","last_peered":"2024-09-15T03:28:05.403600+0000","last_clean":"2024-09-15T03:28:05.403600+0000","last_became_active":"2024-09-15T03:27:24.377366+0000","last_became_peered":"2024-09-15T03:27:24.377366+0000","last_unstale":"2024-09-15T03:28:05.403600+0000","last_undegraded":"2024-09-15T03:28:05.403600+0000","last_fullsized":"2024-09-15T03:28:05.403600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:46:58.012563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987381+0000","last_change":"2024-09-15T03:27:28.529409+0000","last_active":"2024-09-15T03:28:05.987381+0000","last_peered":"2024-09-15T03:28:05.987381+0000","last_clean":"2024-09-15T03:28:05.987381+0000","last_became_active":"2024-09-15T03:27:28.529101+0000","last_became_peered":"2024-09-15T03:27:28.529101+0000","last_unstale":"2024-09-15T03:28:05.987381+0000","last_undegraded":"2024-09-15T03:28:05.987381+0000","last_fullsized":"2024-09-15T03:28:05.987381+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:54:13.109615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987103+0000","last_change":"2024-09-15T03:27:30.557182+0000","last_active":"2024-09-15T03:28:05.987103+0000","last_peered":"2024-09-15T03:28:05.987103+0000","last_clean":"2024-09-15T03:28:05.987103+0000","last_became_active":"2024-09-15T03:27:30.556596+0000","last_became_peered":"2024-09-15T03:27:30.556596+0000","last_unstale":"2024-09-15T03:28:05.987103+0000","last_undegraded":"2024-09-15T03:28:05.987103+0000","last_fullsized":"2024-09-15T03:28:05.987103+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:14:25.209913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":46,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985505+0000","last_change":"2024-09-15T03:27:26.399841+0000","last_active":"2024-09-15T03:28:05.985505+0000","last_peered":"2024-09-15T03:28:05.985505+0000","last_clean":"2024-09-15T03:28:05.985505+0000","last_became_active":"2024-09-15T03:27:26.399488+0000","last_became_peered":"2024-09-15T03:27:26.399488+0000","last_unstale":"2024-09-15T03:28:05.985505+0000","last_undegraded":"2024-09-15T03:28:05.985505+0000","last_fullsized":"2024-09-15T03:28:05.985505+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:25:23.943773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405453+0000","last_change":"2024-09-15T03:27:24.385651+0000","last_active":"2024-09-15T03:28:05.405453+0000","last_peered":"2024-09-15T03:28:05.405453+0000","last_clean":"2024-09-15T03:28:05.405453+0000","last_became_active":"2024-09-15T03:27:24.385258+0000","last_became_peered":"2024-09-15T03:27:24.385258+0000","last_unstale":"2024-09-15T03:28:05.405453+0000","last_undegraded":"2024-09-15T03:28:05.405453+0000","last_fullsized":"2024-09-15T03:28:05.405453+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:24:12.475805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404965+0000","last_change":"2024-09-15T03:27:28.527614+0000","last_active":"2024-09-15T03:28:05.404965+0000","last_peered":"2024-09-15T03:28:05.404965+0000","last_clean":"2024-09-15T03:28:05.404965+0000","last_became_active":"2024-09-15T03:27:28.527304+0000","last_became_peered":"2024-09-15T03:27:28.527304+0000","last_unstale":"2024-09-15T03:28:05.404965+0000","last_undegraded":"2024-09-15T03:28:05.404965+0000","last_fullsized":"2024-09-15T03:28:05.404965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:41:32.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405471+0000","last_change":"2024-09-15T03:27:31.123250+0000","last_active":"2024-09-15T03:28:05.405471+0000","last_peered":"2024-09-15T03:28:05.405471+0000","last_clean":"2024-09-15T03:28:05.405471+0000","last_became_active":"2024-09-15T03:27:31.122791+0000","last_became_peered":"2024-09-15T03:27:31.122791+0000","last_unstale":"2024-09-15T03:28:05.405471+0000","last_undegraded":"2024-09-15T03:28:05.405471+0000","last_fullsized":"2024-09-15T03:28:05.405471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:18:34.416447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"67'17","reported_seq":55,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985745+0000","last_change":"2024-09-15T03:27:26.397467+0000","last_active":"2024-09-15T03:28:05.985745+0000","last_peered":"2024-09-15T03:28:05.985745+0000","last_clean":"2024-09-15T03:28:05.985745+0000","last_became_active":"2024-09-15T03:27:26.397017+0000","last_became_peered":"2024-09-15T03:27:26.397017+0000","last_unstale":"2024-09-15T03:28:05.985745+0000","last_undegraded":"2024-09-15T03:28:05.985745+0000","last_fullsized":"2024-09-15T03:28:05.985745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:46:01.389990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403309+0000","last_change":"2024-09-15T03:27:24.383098+0000","last_active":"2024-09-15T03:28:05.403309+0000","last_peered":"2024-09-15T03:28:05.403309+0000","last_clean":"2024-09-15T03:28:05.403309+0000","last_became_active":"2024-09-15T03:27:24.382728+0000","last_became_peered":"2024-09-15T03:27:24.382728+0000","last_unstale":"2024-09-15T03:28:05.403309+0000","last_undegraded":"2024-09-15T03:28:05.403309+0000","last_fullsized":"2024-09-15T03:28:05.403309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:30:16.946649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"73'12","reported_seq":84,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.491197+0000","last_change":"2024-09-15T03:28:05.409916+0000","last_active":"2024-09-15T03:30:29.491197+0000","last_peered":"2024-09-15T03:30:29.491197+0000","last_clean":"2024-09-15T03:30:29.491197+0000","last_became_active":"2024-09-15T03:28:05.406952+0000","last_became_peered":"2024-09-15T03:28:05.406952+0000","last_unstale":"2024-09-15T03:30:29.491197+0000","last_undegraded":"2024-09-15T03:30:29.491197+0000","last_fullsized":"2024-09-15T03:30:29.491197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:54:09.061884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407667+0000","last_change":"2024-09-15T03:27:30.561579+0000","last_active":"2024-09-15T03:28:05.407667+0000","last_peered":"2024-09-15T03:28:05.407667+0000","last_clean":"2024-09-15T03:28:05.407667+0000","last_became_active":"2024-09-15T03:27:30.561314+0000","last_became_peered":"2024-09-15T03:27:30.561314+0000","last_unstale":"2024-09-15T03:28:05.407667+0000","last_undegraded":"2024-09-15T03:28:05.407667+0000","last_fullsized":"2024-09-15T03:28:05.407667+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:36:26.535500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"67'17","reported_seq":55,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984736+0000","last_change":"2024-09-15T03:27:26.398391+0000","last_active":"2024-09-15T03:28:05.984736+0000","last_peered":"2024-09-15T03:28:05.984736+0000","last_clean":"2024-09-15T03:28:05.984736+0000","last_became_active":"2024-09-15T03:27:26.398100+0000","last_became_peered":"2024-09-15T03:27:26.398100+0000","last_unstale":"2024-09-15T03:28:05.984736+0000","last_undegraded":"2024-09-15T03:28:05.984736+0000","last_fullsized":"2024-09-15T03:28:05.984736+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:12:25.144342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404789+0000","last_change":"2024-09-15T03:27:24.386294+0000","last_active":"2024-09-15T03:28:05.404789+0000","last_peered":"2024-09-15T03:28:05.404789+0000","last_clean":"2024-09-15T03:28:05.404789+0000","last_became_active":"2024-09-15T03:27:24.385890+0000","last_became_peered":"2024-09-15T03:27:24.385890+0000","last_unstale":"2024-09-15T03:28:05.404789+0000","last_undegraded":"2024-09-15T03:28:05.404789+0000","last_fullsized":"2024-09-15T03:28:05.404789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:48.004389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987890+0000","last_change":"2024-09-15T03:27:28.530524+0000","last_active":"2024-09-15T03:28:05.987890+0000","last_peered":"2024-09-15T03:28:05.987890+0000","last_clean":"2024-09-15T03:28:05.987890+0000","last_became_active":"2024-09-15T03:27:28.530283+0000","last_became_peered":"2024-09-15T03:27:28.530283+0000","last_unstale":"2024-09-15T03:28:05.987890+0000","last_undegraded":"2024-09-15T03:28:05.987890+0000","last_fullsized":"2024-09-15T03:28:05.987890+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:54:36.277563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404887+0000","last_change":"2024-09-15T03:27:30.559315+0000","last_active":"2024-09-15T03:28:05.404887+0000","last_peered":"2024-09-15T03:28:05.404887+0000","last_clean":"2024-09-15T03:28:05.404887+0000","last_became_active":"2024-09-15T03:27:30.559019+0000","last_became_peered":"2024-09-15T03:27:30.559019+0000","last_unstale":"2024-09-15T03:28:05.404887+0000","last_undegraded":"2024-09-15T03:28:05.404887+0000","last_fullsized":"2024-09-15T03:28:05.404887+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:53:11.452148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399019+0000","last_change":"2024-09-15T03:27:26.392079+0000","last_active":"2024-09-15T03:28:05.399019+0000","last_peered":"2024-09-15T03:28:05.399019+0000","last_clean":"2024-09-15T03:28:05.399019+0000","last_became_active":"2024-09-15T03:27:26.391766+0000","last_became_peered":"2024-09-15T03:27:26.391766+0000","last_unstale":"2024-09-15T03:28:05.399019+0000","last_undegraded":"2024-09-15T03:28:05.399019+0000","last_fullsized":"2024-09-15T03:28:05.399019+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:46:18.139767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.398996+0000","last_change":"2024-09-15T03:27:24.378466+0000","last_active":"2024-09-15T03:28:05.398996+0000","last_peered":"2024-09-15T03:28:05.398996+0000","last_clean":"2024-09-15T03:28:05.398996+0000","last_became_active":"2024-09-15T03:27:24.378127+0000","last_became_peered":"2024-09-15T03:27:24.378127+0000","last_unstale":"2024-09-15T03:28:05.398996+0000","last_undegraded":"2024-09-15T03:28:05.398996+0000","last_fullsized":"2024-09-15T03:28:05.398996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:45:19.153341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408276+0000","last_change":"2024-09-15T03:27:28.532606+0000","last_active":"2024-09-15T03:28:05.408276+0000","last_peered":"2024-09-15T03:28:05.408276+0000","last_clean":"2024-09-15T03:28:05.408276+0000","last_became_active":"2024-09-15T03:27:28.532307+0000","last_became_peered":"2024-09-15T03:27:28.532307+0000","last_unstale":"2024-09-15T03:28:05.408276+0000","last_undegraded":"2024-09-15T03:28:05.408276+0000","last_fullsized":"2024-09-15T03:28:05.408276+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:19:00.752132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984938+0000","last_change":"2024-09-15T03:27:31.123259+0000","last_active":"2024-09-15T03:28:05.984938+0000","last_peered":"2024-09-15T03:28:05.984938+0000","last_clean":"2024-09-15T03:28:05.984938+0000","last_became_active":"2024-09-15T03:27:31.122752+0000","last_became_peered":"2024-09-15T03:27:31.122752+0000","last_unstale":"2024-09-15T03:28:05.984938+0000","last_undegraded":"2024-09-15T03:28:05.984938+0000","last_fullsized":"2024-09-15T03:28:05.984938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:53:29.153135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985027+0000","last_change":"2024-09-15T03:27:26.653044+0000","last_active":"2024-09-15T03:28:05.985027+0000","last_peered":"2024-09-15T03:28:05.985027+0000","last_clean":"2024-09-15T03:28:05.985027+0000","last_became_active":"2024-09-15T03:27:26.652134+0000","last_became_peered":"2024-09-15T03:27:26.652134+0000","last_unstale":"2024-09-15T03:28:05.985027+0000","last_undegraded":"2024-09-15T03:28:05.985027+0000","last_fullsized":"2024-09-15T03:28:05.985027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:24:19.191551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406170+0000","last_change":"2024-09-15T03:27:24.384571+0000","last_active":"2024-09-15T03:28:05.406170+0000","last_peered":"2024-09-15T03:28:05.406170+0000","last_clean":"2024-09-15T03:28:05.406170+0000","last_became_active":"2024-09-15T03:27:24.383975+0000","last_became_peered":"2024-09-15T03:27:24.383975+0000","last_unstale":"2024-09-15T03:28:05.406170+0000","last_undegraded":"2024-09-15T03:28:05.406170+0000","last_fullsized":"2024-09-15T03:28:05.406170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:54:52.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"67'11","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.493161+0000","last_change":"2024-09-15T03:27:28.531909+0000","last_active":"2024-09-15T03:30:29.493161+0000","last_peered":"2024-09-15T03:30:29.493161+0000","last_clean":"2024-09-15T03:30:29.493161+0000","last_became_active":"2024-09-15T03:27:28.531599+0000","last_became_peered":"2024-09-15T03:27:28.531599+0000","last_unstale":"2024-09-15T03:30:29.493161+0000","last_undegraded":"2024-09-15T03:30:29.493161+0000","last_fullsized":"2024-09-15T03:30:29.493161+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:42:27.896011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987861+0000","last_change":"2024-09-15T03:27:30.557113+0000","last_active":"2024-09-15T03:28:05.987861+0000","last_peered":"2024-09-15T03:28:05.987861+0000","last_clean":"2024-09-15T03:28:05.987861+0000","last_became_active":"2024-09-15T03:27:30.556769+0000","last_became_peered":"2024-09-15T03:27:30.556769+0000","last_unstale":"2024-09-15T03:28:05.987861+0000","last_undegraded":"2024-09-15T03:28:05.987861+0000","last_fullsized":"2024-09-15T03:28:05.987861+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:57:18.883643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987687+0000","last_change":"2024-09-15T03:27:26.396388+0000","last_active":"2024-09-15T03:28:05.987687+0000","last_peered":"2024-09-15T03:28:05.987687+0000","last_clean":"2024-09-15T03:28:05.987687+0000","last_became_active":"2024-09-15T03:27:26.395965+0000","last_became_peered":"2024-09-15T03:27:26.395965+0000","last_unstale":"2024-09-15T03:28:05.987687+0000","last_undegraded":"2024-09-15T03:28:05.987687+0000","last_fullsized":"2024-09-15T03:28:05.987687+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:42:17.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988307+0000","last_change":"2024-09-15T03:27:24.384550+0000","last_active":"2024-09-15T03:28:05.988307+0000","last_peered":"2024-09-15T03:28:05.988307+0000","last_clean":"2024-09-15T03:28:05.988307+0000","last_became_active":"2024-09-15T03:27:24.384162+0000","last_became_peered":"2024-09-15T03:27:24.384162+0000","last_unstale":"2024-09-15T03:28:05.988307+0000","last_undegraded":"2024-09-15T03:28:05.988307+0000","last_fullsized":"2024-09-15T03:28:05.988307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:46:41.627891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"67'11","reported_seq":69,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.490733+0000","last_change":"2024-09-15T03:27:28.530401+0000","last_active":"2024-09-15T03:30:29.490733+0000","last_peered":"2024-09-15T03:30:29.490733+0000","last_clean":"2024-09-15T03:30:29.490733+0000","last_became_active":"2024-09-15T03:27:28.530103+0000","last_became_peered":"2024-09-15T03:27:28.530103+0000","last_unstale":"2024-09-15T03:30:29.490733+0000","last_undegraded":"2024-09-15T03:30:29.490733+0000","last_fullsized":"2024-09-15T03:30:29.490733+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:26:37.412515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403189+0000","last_change":"2024-09-15T03:27:30.555631+0000","last_active":"2024-09-15T03:28:05.403189+0000","last_peered":"2024-09-15T03:28:05.403189+0000","last_clean":"2024-09-15T03:28:05.403189+0000","last_became_active":"2024-09-15T03:27:30.555324+0000","last_became_peered":"2024-09-15T03:27:30.555324+0000","last_unstale":"2024-09-15T03:28:05.403189+0000","last_undegraded":"2024-09-15T03:28:05.403189+0000","last_fullsized":"2024-09-15T03:28:05.403189+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:42:41.560322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"67'15","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985277+0000","last_change":"2024-09-15T03:27:26.397456+0000","last_active":"2024-09-15T03:28:05.985277+0000","last_peered":"2024-09-15T03:28:05.985277+0000","last_clean":"2024-09-15T03:28:05.985277+0000","last_became_active":"2024-09-15T03:27:26.397117+0000","last_became_peered":"2024-09-15T03:27:26.397117+0000","last_unstale":"2024-09-15T03:28:05.985277+0000","last_undegraded":"2024-09-15T03:28:05.985277+0000","last_fullsized":"2024-09-15T03:28:05.985277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:57:07.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399570+0000","last_change":"2024-09-15T03:27:24.381126+0000","last_active":"2024-09-15T03:28:05.399570+0000","last_peered":"2024-09-15T03:28:05.399570+0000","last_clean":"2024-09-15T03:28:05.399570+0000","last_became_active":"2024-09-15T03:27:24.380849+0000","last_became_peered":"2024-09-15T03:27:24.380849+0000","last_unstale":"2024-09-15T03:28:05.399570+0000","last_undegraded":"2024-09-15T03:28:05.399570+0000","last_fullsized":"2024-09-15T03:28:05.399570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:53:45.651768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402189+0000","last_change":"2024-09-15T03:27:28.525206+0000","last_active":"2024-09-15T03:28:05.402189+0000","last_peered":"2024-09-15T03:28:05.402189+0000","last_clean":"2024-09-15T03:28:05.402189+0000","last_became_active":"2024-09-15T03:27:28.524485+0000","last_became_peered":"2024-09-15T03:27:28.524485+0000","last_unstale":"2024-09-15T03:28:05.402189+0000","last_undegraded":"2024-09-15T03:28:05.402189+0000","last_fullsized":"2024-09-15T03:28:05.402189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:52:28.137570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987032+0000","last_change":"2024-09-15T03:27:30.553160+0000","last_active":"2024-09-15T03:28:05.987032+0000","last_peered":"2024-09-15T03:28:05.987032+0000","last_clean":"2024-09-15T03:28:05.987032+0000","last_became_active":"2024-09-15T03:27:30.552441+0000","last_became_peered":"2024-09-15T03:27:30.552441+0000","last_unstale":"2024-09-15T03:28:05.987032+0000","last_undegraded":"2024-09-15T03:28:05.987032+0000","last_fullsized":"2024-09-15T03:28:05.987032+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:42:02.707852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"67'23","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402370+0000","last_change":"2024-09-15T03:27:26.400026+0000","last_active":"2024-09-15T03:28:05.402370+0000","last_peered":"2024-09-15T03:28:05.402370+0000","last_clean":"2024-09-15T03:28:05.402370+0000","last_became_active":"2024-09-15T03:27:26.399663+0000","last_became_peered":"2024-09-15T03:27:26.399663+0000","last_unstale":"2024-09-15T03:28:05.402370+0000","last_undegraded":"2024-09-15T03:28:05.402370+0000","last_fullsized":"2024-09-15T03:28:05.402370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:41:57.103303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":32,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403437+0000","last_change":"2024-09-15T03:27:24.388917+0000","last_active":"2024-09-15T03:28:05.403437+0000","last_peered":"2024-09-15T03:28:05.403437+0000","last_clean":"2024-09-15T03:28:05.403437+0000","last_became_active":"2024-09-15T03:27:24.388593+0000","last_became_peered":"2024-09-15T03:27:24.388593+0000","last_unstale":"2024-09-15T03:28:05.403437+0000","last_undegraded":"2024-09-15T03:28:05.403437+0000","last_fullsized":"2024-09-15T03:28:05.403437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:49:13.735144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402183+0000","last_change":"2024-09-15T03:27:28.521072+0000","last_active":"2024-09-15T03:28:05.402183+0000","last_peered":"2024-09-15T03:28:05.402183+0000","last_clean":"2024-09-15T03:28:05.402183+0000","last_became_active":"2024-09-15T03:27:28.520707+0000","last_became_peered":"2024-09-15T03:27:28.520707+0000","last_unstale":"2024-09-15T03:28:05.402183+0000","last_undegraded":"2024-09-15T03:28:05.402183+0000","last_fullsized":"2024-09-15T03:28:05.402183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:21:30.862258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407008+0000","last_change":"2024-09-15T03:27:30.556332+0000","last_active":"2024-09-15T03:28:05.407008+0000","last_peered":"2024-09-15T03:28:05.407008+0000","last_clean":"2024-09-15T03:28:05.407008+0000","last_became_active":"2024-09-15T03:27:30.555391+0000","last_became_peered":"2024-09-15T03:27:30.555391+0000","last_unstale":"2024-09-15T03:28:05.407008+0000","last_undegraded":"2024-09-15T03:28:05.407008+0000","last_fullsized":"2024-09-15T03:28:05.407008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:07:22.902408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'12","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988347+0000","last_change":"2024-09-15T03:27:26.398405+0000","last_active":"2024-09-15T03:28:05.988347+0000","last_peered":"2024-09-15T03:28:05.988347+0000","last_clean":"2024-09-15T03:28:05.988347+0000","last_became_active":"2024-09-15T03:27:26.398071+0000","last_became_peered":"2024-09-15T03:27:26.398071+0000","last_unstale":"2024-09-15T03:28:05.988347+0000","last_undegraded":"2024-09-15T03:28:05.988347+0000","last_fullsized":"2024-09-15T03:28:05.988347+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:05:41.955098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"60'1","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406189+0000","last_change":"2024-09-15T03:27:24.379552+0000","last_active":"2024-09-15T03:28:05.406189+0000","last_peered":"2024-09-15T03:28:05.406189+0000","last_clean":"2024-09-15T03:28:05.406189+0000","last_became_active":"2024-09-15T03:27:24.379231+0000","last_became_peered":"2024-09-15T03:27:24.379231+0000","last_unstale":"2024-09-15T03:28:05.406189+0000","last_undegraded":"2024-09-15T03:28:05.406189+0000","last_fullsized":"2024-09-15T03:28:05.406189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:04:04.223376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407053+0000","last_change":"2024-09-15T03:27:28.535688+0000","last_active":"2024-09-15T03:28:05.407053+0000","last_peered":"2024-09-15T03:28:05.407053+0000","last_clean":"2024-09-15T03:28:05.407053+0000","last_became_active":"2024-09-15T03:27:28.535433+0000","last_became_peered":"2024-09-15T03:27:28.535433+0000","last_unstale":"2024-09-15T03:28:05.407053+0000","last_undegraded":"2024-09-15T03:28:05.407053+0000","last_fullsized":"2024-09-15T03:28:05.407053+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:46:00.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984593+0000","last_change":"2024-09-15T03:27:30.550017+0000","last_active":"2024-09-15T03:28:05.984593+0000","last_peered":"2024-09-15T03:28:05.984593+0000","last_clean":"2024-09-15T03:28:05.984593+0000","last_became_active":"2024-09-15T03:27:30.549746+0000","last_became_peered":"2024-09-15T03:27:30.549746+0000","last_unstale":"2024-09-15T03:28:05.984593+0000","last_undegraded":"2024-09-15T03:28:05.984593+0000","last_fullsized":"2024-09-15T03:28:05.984593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:01:32.559554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"67'21","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406073+0000","last_change":"2024-09-15T03:27:26.395561+0000","last_active":"2024-09-15T03:28:05.406073+0000","last_peered":"2024-09-15T03:28:05.406073+0000","last_clean":"2024-09-15T03:28:05.406073+0000","last_became_active":"2024-09-15T03:27:26.395038+0000","last_became_peered":"2024-09-15T03:27:26.395038+0000","last_unstale":"2024-09-15T03:28:05.406073+0000","last_undegraded":"2024-09-15T03:28:05.406073+0000","last_fullsized":"2024-09-15T03:28:05.406073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:19:44.971168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.400253+0000","last_change":"2024-09-15T03:27:24.381075+0000","last_active":"2024-09-15T03:28:05.400253+0000","last_peered":"2024-09-15T03:28:05.400253+0000","last_clean":"2024-09-15T03:28:05.400253+0000","last_became_active":"2024-09-15T03:27:24.380562+0000","last_became_peered":"2024-09-15T03:27:24.380562+0000","last_unstale":"2024-09-15T03:28:05.400253+0000","last_undegraded":"2024-09-15T03:28:05.400253+0000","last_fullsized":"2024-09-15T03:28:05.400253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:09:30.894997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407151+0000","last_change":"2024-09-15T03:27:28.536165+0000","last_active":"2024-09-15T03:28:05.407151+0000","last_peered":"2024-09-15T03:28:05.407151+0000","last_clean":"2024-09-15T03:28:05.407151+0000","last_became_active":"2024-09-15T03:27:28.535913+0000","last_became_peered":"2024-09-15T03:27:28.535913+0000","last_unstale":"2024-09-15T03:28:05.407151+0000","last_undegraded":"2024-09-15T03:28:05.407151+0000","last_fullsized":"2024-09-15T03:28:05.407151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:35:16.964691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408310+0000","last_change":"2024-09-15T03:27:31.124777+0000","last_active":"2024-09-15T03:28:05.408310+0000","last_peered":"2024-09-15T03:28:05.408310+0000","last_clean":"2024-09-15T03:28:05.408310+0000","last_became_active":"2024-09-15T03:27:31.124208+0000","last_became_peered":"2024-09-15T03:27:31.124208+0000","last_unstale":"2024-09-15T03:28:05.408310+0000","last_undegraded":"2024-09-15T03:28:05.408310+0000","last_fullsized":"2024-09-15T03:28:05.408310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:28:52.532727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985294+0000","last_change":"2024-09-15T03:27:30.555019+0000","last_active":"2024-09-15T03:28:05.985294+0000","last_peered":"2024-09-15T03:28:05.985294+0000","last_clean":"2024-09-15T03:28:05.985294+0000","last_became_active":"2024-09-15T03:27:30.554701+0000","last_became_peered":"2024-09-15T03:27:30.554701+0000","last_unstale":"2024-09-15T03:28:05.985294+0000","last_undegraded":"2024-09-15T03:28:05.985294+0000","last_fullsized":"2024-09-15T03:28:05.985294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:46:26.912828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"67'39","reported_seq":106,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401239+0000","last_change":"2024-09-15T03:27:26.399720+0000","last_active":"2024-09-15T03:28:05.401239+0000","last_peered":"2024-09-15T03:28:05.401239+0000","last_clean":"2024-09-15T03:28:05.401239+0000","last_became_active":"2024-09-15T03:27:26.399358+0000","last_became_peered":"2024-09-15T03:27:26.399358+0000","last_unstale":"2024-09-15T03:28:05.401239+0000","last_undegraded":"2024-09-15T03:28:05.401239+0000","last_fullsized":"2024-09-15T03:28:05.401239+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:15:01.840364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405133+0000","last_change":"2024-09-15T03:27:24.384148+0000","last_active":"2024-09-15T03:28:05.405133+0000","last_peered":"2024-09-15T03:28:05.405133+0000","last_clean":"2024-09-15T03:28:05.405133+0000","last_became_active":"2024-09-15T03:27:24.383789+0000","last_became_peered":"2024-09-15T03:27:24.383789+0000","last_unstale":"2024-09-15T03:28:05.405133+0000","last_undegraded":"2024-09-15T03:28:05.405133+0000","last_fullsized":"2024-09-15T03:28:05.405133+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:48:24.252555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987799+0000","last_change":"2024-09-15T03:27:28.530455+0000","last_active":"2024-09-15T03:28:05.987799+0000","last_peered":"2024-09-15T03:28:05.987799+0000","last_clean":"2024-09-15T03:28:05.987799+0000","last_became_active":"2024-09-15T03:27:28.530170+0000","last_became_peered":"2024-09-15T03:27:28.530170+0000","last_unstale":"2024-09-15T03:28:05.987799+0000","last_undegraded":"2024-09-15T03:28:05.987799+0000","last_fullsized":"2024-09-15T03:28:05.987799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:04.159954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403746+0000","last_change":"2024-09-15T03:27:30.555093+0000","last_active":"2024-09-15T03:28:05.403746+0000","last_peered":"2024-09-15T03:28:05.403746+0000","last_clean":"2024-09-15T03:28:05.403746+0000","last_became_active":"2024-09-15T03:27:30.554827+0000","last_became_peered":"2024-09-15T03:27:30.554827+0000","last_unstale":"2024-09-15T03:28:05.403746+0000","last_undegraded":"2024-09-15T03:28:05.403746+0000","last_fullsized":"2024-09-15T03:28:05.403746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:19:34.507008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"67'15","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407515+0000","last_change":"2024-09-15T03:27:26.401711+0000","last_active":"2024-09-15T03:28:05.407515+0000","last_peered":"2024-09-15T03:28:05.407515+0000","last_clean":"2024-09-15T03:28:05.407515+0000","last_became_active":"2024-09-15T03:27:26.401394+0000","last_became_peered":"2024-09-15T03:27:26.401394+0000","last_unstale":"2024-09-15T03:28:05.407515+0000","last_undegraded":"2024-09-15T03:28:05.407515+0000","last_fullsized":"2024-09-15T03:28:05.407515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:39:59.009034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408134+0000","last_change":"2024-09-15T03:27:24.378542+0000","last_active":"2024-09-15T03:28:05.408134+0000","last_peered":"2024-09-15T03:28:05.408134+0000","last_clean":"2024-09-15T03:28:05.408134+0000","last_became_active":"2024-09-15T03:27:24.378021+0000","last_became_peered":"2024-09-15T03:27:24.378021+0000","last_unstale":"2024-09-15T03:28:05.408134+0000","last_undegraded":"2024-09-15T03:28:05.408134+0000","last_fullsized":"2024-09-15T03:28:05.408134+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:09:01.141007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"73'12","reported_seq":87,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:29.490800+0000","last_change":"2024-09-15T03:28:05.408604+0000","last_active":"2024-09-15T03:30:29.490800+0000","last_peered":"2024-09-15T03:30:29.490800+0000","last_clean":"2024-09-15T03:30:29.490800+0000","last_became_active":"2024-09-15T03:28:05.405547+0000","last_became_peered":"2024-09-15T03:28:05.405547+0000","last_unstale":"2024-09-15T03:30:29.490800+0000","last_undegraded":"2024-09-15T03:30:29.490800+0000","last_fullsized":"2024-09-15T03:30:29.490800+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:38:51.932395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402689+0000","last_change":"2024-09-15T03:27:31.121221+0000","last_active":"2024-09-15T03:28:05.402689+0000","last_peered":"2024-09-15T03:28:05.402689+0000","last_clean":"2024-09-15T03:28:05.402689+0000","last_became_active":"2024-09-15T03:27:31.120354+0000","last_became_peered":"2024-09-15T03:27:31.120354+0000","last_unstale":"2024-09-15T03:28:05.402689+0000","last_undegraded":"2024-09-15T03:28:05.402689+0000","last_fullsized":"2024-09-15T03:28:05.402689+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:35:22.253196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399301+0000","last_change":"2024-09-15T03:27:24.385888+0000","last_active":"2024-09-15T03:28:05.399301+0000","last_peered":"2024-09-15T03:28:05.399301+0000","last_clean":"2024-09-15T03:28:05.399301+0000","last_became_active":"2024-09-15T03:27:24.385563+0000","last_became_peered":"2024-09-15T03:27:24.385563+0000","last_unstale":"2024-09-15T03:28:05.399301+0000","last_undegraded":"2024-09-15T03:28:05.399301+0000","last_fullsized":"2024-09-15T03:28:05.399301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:55:18.192592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'11","reported_seq":46,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988029+0000","last_change":"2024-09-15T03:27:26.394035+0000","last_active":"2024-09-15T03:28:05.988029+0000","last_peered":"2024-09-15T03:28:05.988029+0000","last_clean":"2024-09-15T03:28:05.988029+0000","last_became_active":"2024-09-15T03:27:26.393117+0000","last_became_peered":"2024-09-15T03:27:26.393117+0000","last_unstale":"2024-09-15T03:28:05.988029+0000","last_undegraded":"2024-09-15T03:28:05.988029+0000","last_fullsized":"2024-09-15T03:28:05.988029+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:46:36.750732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405673+0000","last_change":"2024-09-15T03:27:28.526869+0000","last_active":"2024-09-15T03:28:05.405673+0000","last_peered":"2024-09-15T03:28:05.405673+0000","last_clean":"2024-09-15T03:28:05.405673+0000","last_became_active":"2024-09-15T03:27:28.526477+0000","last_became_peered":"2024-09-15T03:27:28.526477+0000","last_unstale":"2024-09-15T03:28:05.405673+0000","last_undegraded":"2024-09-15T03:28:05.405673+0000","last_fullsized":"2024-09-15T03:28:05.405673+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:39:18.512369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408066+0000","last_change":"2024-09-15T03:27:31.122974+0000","last_active":"2024-09-15T03:28:05.408066+0000","last_peered":"2024-09-15T03:28:05.408066+0000","last_clean":"2024-09-15T03:28:05.408066+0000","last_became_active":"2024-09-15T03:27:31.122432+0000","last_became_peered":"2024-09-15T03:27:31.122432+0000","last_unstale":"2024-09-15T03:28:05.408066+0000","last_undegraded":"2024-09-15T03:28:05.408066+0000","last_fullsized":"2024-09-15T03:28:05.408066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:44:21.490206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408441+0000","last_change":"2024-09-15T03:27:24.388762+0000","last_active":"2024-09-15T03:28:05.408441+0000","last_peered":"2024-09-15T03:28:05.408441+0000","last_clean":"2024-09-15T03:28:05.408441+0000","last_became_active":"2024-09-15T03:27:24.388368+0000","last_became_peered":"2024-09-15T03:27:24.388368+0000","last_unstale":"2024-09-15T03:28:05.408441+0000","last_undegraded":"2024-09-15T03:28:05.408441+0000","last_fullsized":"2024-09-15T03:28:05.408441+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:35:15.391745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'21","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402371+0000","last_change":"2024-09-15T03:27:26.652414+0000","last_active":"2024-09-15T03:28:05.402371+0000","last_peered":"2024-09-15T03:28:05.402371+0000","last_clean":"2024-09-15T03:28:05.402371+0000","last_became_active":"2024-09-15T03:27:26.651962+0000","last_became_peered":"2024-09-15T03:27:26.651962+0000","last_unstale":"2024-09-15T03:28:05.402371+0000","last_undegraded":"2024-09-15T03:28:05.402371+0000","last_fullsized":"2024-09-15T03:28:05.402371+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:43:06.095685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407997+0000","last_change":"2024-09-15T03:27:28.533333+0000","last_active":"2024-09-15T03:28:05.407997+0000","last_peered":"2024-09-15T03:28:05.407997+0000","last_clean":"2024-09-15T03:28:05.407997+0000","last_became_active":"2024-09-15T03:27:28.532762+0000","last_became_peered":"2024-09-15T03:27:28.532762+0000","last_unstale":"2024-09-15T03:28:05.407997+0000","last_undegraded":"2024-09-15T03:28:05.407997+0000","last_fullsized":"2024-09-15T03:28:05.407997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:53:03.735966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":166,"num_read_kb":161,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":1085,"num_read_kb":810,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":586,"ondisk_log_size":586,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1328,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":258,"num_write":179,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234034,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298764,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442292,"statfs":{"total":95990841344,"available":95684907008,"internally_reserved":0,"allocated":1441792,"data_stored":942637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.85499999999999998,"15min":0.89000000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90200000000000002,"15min":0.95199999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.056,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.177}]},{"osd":1,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.873,"15min":0.90900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.147,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":1},{"interface":"front","average":{"1min":0.751,"5min":0.85299999999999998,"15min":0.89200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.96299999999999997}]},{"osd":2,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.91000000000000003,"15min":0.95799999999999996},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.88500000000000001,"15min":0.90800000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.75800000000000001}]},{"osd":3,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.90800000000000003,"15min":0.95499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.95099999999999996,"15min":0.997},"min":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3029999999999999,"5min":1.333,"15min":1.333},"last":0.90900000000000003}]},{"osd":4,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.753,"15min":0.78500000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96399999999999997,"5min":1.119,"15min":1.119},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.84699999999999998,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.94099999999999995}]},{"osd":5,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.87,"15min":0.89900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.115},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.879,"15min":0.93300000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.123,"5min":1.246,"15min":1.246},"last":1.089}]},{"osd":6,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.90100000000000002,"15min":0.94699999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0409999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.82499999999999996}]}]},{"osd":6,"up_from":46,"seq":197568495677,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298728,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442328,"statfs":{"total":95990841344,"available":95684943872,"internally_reserved":0,"allocated":1409024,"data_stored":941834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81299999999999994,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0409999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.504},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.80200000000000005,"15min":0.83499999999999996},"min":{"1min":0.52600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.71299999999999997}]},{"osd":1,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83699999999999997,"15min":0.86899999999999999},"min":{"1min":0.58399999999999996,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.61499999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.252,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79100000000000004,"15min":0.80900000000000005},"min":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.141,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.76300000000000001}]},{"osd":3,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89700000000000002,"15min":0.91500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1439999999999999,"5min":1.345,"15min":1.345},"last":0.746},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":0.88400000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.443,"5min":0.377,"15min":0.377},"max":{"1min":1.0840000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.373,"15min":1.373},"last":0.38500000000000001}]},{"osd":5,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.44600000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2470000000000001,"5min":1.389,"15min":1.389},"last":0.443}]},{"osd":7,"last update":"Sun Sep 15 03:29:46 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93799999999999994,"15min":0.97799999999999998},"min":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.96999999999999997,"15min":1.0049999999999999},"min":{"1min":0.503,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2969999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.65100000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298156,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442900,"statfs":{"total":95990841344,"available":95685529600,"internally_reserved":0,"allocated":819200,"data_stored":351894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81599999999999995,"15min":0.78100000000000003},"min":{"1min":0.50700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1359999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.82499999999999996}]},{"osd":1,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.83999999999999997,"15min":0.83799999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2050000000000001,"5min":1.264,"15min":1.264},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.83399999999999996},"min":{"1min":0.45200000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98599999999999999,"5min":1.159,"15min":1.159},"last":0.92800000000000005}]},{"osd":2,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.55600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.073,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.05},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85099999999999998,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.98799999999999999}]},{"osd":3,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.103,"5min":1.387,"15min":1.387},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.86699999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.91800000000000004}]},{"osd":4,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.376,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.01,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.161,"5min":1.3,"15min":1.3},"last":0.64900000000000002}]},{"osd":6,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.48299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.125,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.81999999999999995},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.0980000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.0049999999999999}]},{"osd":7,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.52500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0409999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.876},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.026}]}]},{"osd":4,"up_from":30,"seq":128849018965,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298192,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442864,"statfs":{"total":95990841344,"available":95685492736,"internally_reserved":0,"allocated":856064,"data_stored":352606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.83699999999999997,"15min":0.84399999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96999999999999997,"5min":1.613,"15min":1.613},"last":0.70399999999999996}]},{"osd":1,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.60099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3939999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.63},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.872,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.232,"5min":1.349,"15min":1.349},"last":0.99299999999999999}]},{"osd":3,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.88900000000000001},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1899999999999999,"5min":1.274,"15min":1.47},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.155,"5min":1.2010000000000001,"15min":1.2549999999999999},"last":0.745}]},{"osd":5,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.753,"15min":0.70699999999999996},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7130000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":1.032},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.70899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0940000000000001,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":0.98799999999999999},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.1850000000000001,"5min":2.895,"15min":2.895},"last":0.82299999999999995}]},{"osd":7,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88,"15min":0.89800000000000002},"min":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.93700000000000006},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":0.89900000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182497,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442904,"statfs":{"total":95990841344,"available":95685533696,"internally_reserved":0,"allocated":815104,"data_stored":351329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.69399999999999995,"15min":0.67800000000000005},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.92900000000000005,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.373,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.73699999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.079,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.751}]},{"osd":2,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.79800000000000004,"15min":0.77300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35699999999999998},"max":{"1min":0.98799999999999999,"5min":1.276,"15min":1.276},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.153,"5min":1.228,"15min":1.228},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.92000000000000004,"15min":0.90000000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2809999999999999,"5min":1.2889999999999999,"15min":1.407},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0169999999999999,"15min":0.93899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":1.083}]},{"osd":5,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0329999999999999,"15min":1.032},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3560000000000001,"5min":1.581,"15min":1.581},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.444,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97699999999999998,"15min":0.97499999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.95599999999999996}]},{"osd":7,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0229999999999999,"15min":1.0389999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.048,"15min":1.0569999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.153}]}]},{"osd":2,"up_from":18,"seq":77309411436,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298156,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442900,"statfs":{"total":95990841344,"available":95685529600,"internally_reserved":0,"allocated":819200,"data_stored":351647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.623},"min":{"1min":0.47099999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1200000000000001,"5min":1.165,"15min":1.165},"last":0.495},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67600000000000005,"15min":0.63800000000000001},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.97399999999999998,"5min":1.026,"15min":1.946},"last":0.79700000000000004}]},{"osd":1,"last update":"Sun Sep 15 03:29:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.67500000000000004},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.753},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69999999999999996,"15min":0.64100000000000001},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.27800000000000002},"max":{"1min":1.0580000000000001,"5min":1.379,"15min":1.379},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81499999999999995,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.436,"5min":0.316,"15min":0.316},"max":{"1min":1.0820000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67800000000000005}]},{"osd":4,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91800000000000004,"15min":0.89600000000000002},"min":{"1min":0.53200000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.169,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.175},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.008,"15min":0.97199999999999998},"min":{"1min":0.64100000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.4370000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.127}]},{"osd":5,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.997,"15min":0.95699999999999996},"min":{"1min":0.63100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.052},{"interface":"front","average":{"1min":0.878,"5min":0.91900000000000004,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2330000000000001,"5min":1.254,"15min":1.254},"last":1.022}]},{"osd":6,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.87,"15min":0.85999999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1000000000000001,"5min":1.244,"15min":1.244},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.079,"15min":1.087},"min":{"1min":0.65000000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.96499999999999997}]},{"osd":7,"last update":"Sun Sep 15 03:29:44 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.99299999999999999,"15min":1.012},"min":{"1min":0.63,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2949999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.131,"15min":1.1419999999999999},"min":{"1min":0.71599999999999997,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.21}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298164,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442892,"statfs":{"total":95990841344,"available":95685521408,"internally_reserved":0,"allocated":827392,"data_stored":351630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67700000000000005,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76200000000000001,"15min":0.629},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.318},"max":{"1min":1.008,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.82799999999999996}]},{"osd":2,"last update":"Sun Sep 15 03:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.63200000000000001},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6799999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.82699999999999996,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.434,"15min":0.35899999999999999},"max":{"1min":1.466,"5min":1.546,"15min":1.546},"last":1.0249999999999999}]},{"osd":3,"last update":"Sun Sep 15 03:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.85899999999999999,"15min":0.79100000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2070000000000001,"5min":1.321,"15min":1.321},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.745},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6180000000000001,"5min":2.831,"15min":2.831},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.96599999999999997,"15min":0.88500000000000001},"min":{"1min":0.76000000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2330000000000001,"5min":1.885,"15min":1.885},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.05,"5min":1.014,"15min":0.92600000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.431,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.89900000000000002},"min":{"1min":0.71399999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.181,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1100000000000001,"15min":1.0209999999999999},"min":{"1min":0.74399999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4450000000000001,"5min":8.782,"15min":8.782},"last":0.95899999999999996}]},{"osd":6,"last update":"Sun Sep 15 03:29:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.091,"15min":1.0409999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.4289999999999998,"5min":4.9409999999999998,"15min":4.9409999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0469999999999999,"15min":1.0109999999999999},"min":{"1min":0.83899999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2270000000000001,"5min":4.899,"15min":4.899},"last":1.123}]},{"osd":7,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1359999999999999,"15min":1.1519999999999999},"min":{"1min":0.76900000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.3100000000000001,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":1.181},{"interface":"front","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1890000000000001},"min":{"1min":0.755,"5min":0.748,"15min":0.748},"max":{"1min":1.536,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.95099999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738498,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298744,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442312,"statfs":{"total":95990841344,"available":95684927488,"internally_reserved":0,"allocated":1425408,"data_stored":941944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 15 03:30:07 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70399999999999996,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.29199999999999998},"max":{"1min":1.052,"5min":2.544,"15min":2.544},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70799999999999996,"15min":0.61099999999999999},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.879}]},{"osd":2,"last update":"Sun Sep 15 03:30:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.746,"15min":0.66800000000000004},"min":{"1min":0.41099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.24,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73999999999999999,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.228,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":1}]},{"osd":3,"last update":"Sun Sep 15 03:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71799999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93999999999999995,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81499999999999995,"15min":0.76400000000000001},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.135,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.3220000000000001}]},{"osd":4,"last update":"Sun Sep 15 03:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96799999999999997,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.27,"5min":1.3049999999999999,"15min":1.3109999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.92500000000000004,"15min":0.91600000000000004},"min":{"1min":0.66700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.121,"5min":1.323,"15min":1.323},"last":1.1870000000000001}]},{"osd":5,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96399999999999997,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.375,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90600000000000003,"15min":0.92300000000000004},"min":{"1min":0.67800000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3979999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0369999999999999,"15min":1.0549999999999999},"min":{"1min":0.60399999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96299999999999997,"15min":0.95199999999999996},"min":{"1min":0.73999999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2070000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1080000000000001}]},{"osd":7,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.036,"15min":1.036},"min":{"1min":0.71099999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.429},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.034,"15min":1.054},"min":{"1min":0.71599999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.137,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2769999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T03:30:41.157 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T03:30:42.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:42 smithi053 bash[21662]: audit 2024-09-15T03:30:40.392535+0000 mgr.y (mgr.24494) 117 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:30:42.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:42 smithi053 bash[21662]: cluster 2024-09-15T03:30:41.049956+0000 mgr.y (mgr.24494) 118 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:42.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:42 smithi053 bash[21662]: audit 2024-09-15T03:30:42.090123+0000 mon.a (mon.0) 1226 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:42 smithi053 bash[15077]: audit 2024-09-15T03:30:40.392535+0000 mgr.y (mgr.24494) 117 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:30:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:42 smithi053 bash[15077]: cluster 2024-09-15T03:30:41.049956+0000 mgr.y (mgr.24494) 118 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:42 smithi053 bash[15077]: audit 2024-09-15T03:30:42.090123+0000 mon.a (mon.0) 1226 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:42 smithi104 bash[15781]: audit 2024-09-15T03:30:40.392535+0000 mgr.y (mgr.24494) 117 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:30:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:42 smithi104 bash[15781]: cluster 2024-09-15T03:30:41.049956+0000 mgr.y (mgr.24494) 118 : cluster [DBG] pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:42 smithi104 bash[15781]: audit 2024-09-15T03:30:42.090123+0000 mon.a (mon.0) 1226 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:43.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:30:42 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:42] "GET /metrics HTTP/1.1" 200 219603 "" "Prometheus/2.43.0" 2024-09-15T03:30:44.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:44 smithi053 bash[15077]: cluster 2024-09-15T03:30:43.051330+0000 mgr.y (mgr.24494) 119 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:44.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:44 smithi053 bash[21662]: cluster 2024-09-15T03:30:43.051330+0000 mgr.y (mgr.24494) 119 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:44 smithi104 bash[15781]: cluster 2024-09-15T03:30:43.051330+0000 mgr.y (mgr.24494) 119 : cluster [DBG] pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:44.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:30:44 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:44] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:30:45.977 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:46.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:46 smithi053 bash[21662]: cluster 2024-09-15T03:30:45.052146+0000 mgr.y (mgr.24494) 120 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:46.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:46 smithi053 bash[15077]: cluster 2024-09-15T03:30:45.052146+0000 mgr.y (mgr.24494) 120 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:46.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:46 smithi104 bash[15781]: cluster 2024-09-15T03:30:45.052146+0000 mgr.y (mgr.24494) 120 : cluster [DBG] pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:48.019 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[15077]: audit 2024-09-15T03:30:46.753736+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.019 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[15077]: audit 2024-09-15T03:30:46.759971+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.019 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[15077]: audit 2024-09-15T03:30:46.765607+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.019 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[15077]: cluster 2024-09-15T03:30:47.052783+0000 mgr.y (mgr.24494) 121 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:48.019 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[21662]: audit 2024-09-15T03:30:46.753736+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.020 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[21662]: audit 2024-09-15T03:30:46.759971+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.020 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[21662]: audit 2024-09-15T03:30:46.765607+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.020 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:47 smithi053 bash[21662]: cluster 2024-09-15T03:30:47.052783+0000 mgr.y (mgr.24494) 121 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:48.116 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:47 smithi104 bash[15781]: audit 2024-09-15T03:30:46.753736+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.117 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:47 smithi104 bash[15781]: audit 2024-09-15T03:30:46.759971+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.117 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:47 smithi104 bash[15781]: audit 2024-09-15T03:30:46.765607+0000 mon.a (mon.0) 1229 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:48.117 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:47 smithi104 bash[15781]: cluster 2024-09-15T03:30:47.052783+0000 mgr.y (mgr.24494) 121 : cluster [DBG] pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-09-15T03:30:48.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:30:48 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:30:49.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[21662]: audit 2024-09-15T03:30:48.099595+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[21662]: audit 2024-09-15T03:30:48.106078+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[21662]: audit 2024-09-15T03:30:48.113036+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[21662]: audit 2024-09-15T03:30:48.127254+0000 mgr.y (mgr.24494) 122 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:49.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[15077]: audit 2024-09-15T03:30:48.099595+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[15077]: audit 2024-09-15T03:30:48.106078+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[15077]: audit 2024-09-15T03:30:48.113036+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:49 smithi053 bash[15077]: audit 2024-09-15T03:30:48.127254+0000 mgr.y (mgr.24494) 122 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:49.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:49 smithi104 bash[15781]: audit 2024-09-15T03:30:48.099595+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:49 smithi104 bash[15781]: audit 2024-09-15T03:30:48.106078+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:49 smithi104 bash[15781]: audit 2024-09-15T03:30:48.113036+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:30:49.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:49 smithi104 bash[15781]: audit 2024-09-15T03:30:48.127254+0000 mgr.y (mgr.24494) 122 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:50.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:50 smithi053 bash[15077]: cluster 2024-09-15T03:30:49.054149+0000 mgr.y (mgr.24494) 123 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:50.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:50 smithi053 bash[21662]: cluster 2024-09-15T03:30:49.054149+0000 mgr.y (mgr.24494) 123 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:50.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:50 smithi104 bash[15781]: cluster 2024-09-15T03:30:49.054149+0000 mgr.y (mgr.24494) 123 : cluster [DBG] pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:51.013 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:30:51.015 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-09-15T03:30:51.637 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2024-09-15T03:30:49.053016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596188,"num_objects":228,"num_object_clones":0,"num_object_copies":684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1462,"num_read_kb":1283,"num_write":801,"num_write_kb":3237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":829,"ondisk_log_size":829,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749928448,"kb_used":2387056,"kb_used_data":8216,"kb_used_omap":13,"kb_used_meta":2378738,"kb_avail":747541392,"statfs":{"total":767926730752,"available":765482385408,"internally_reserved":0,"allocated":8413184,"data_stored":4585521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2435828416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004945"},"pg_stats":[{"pgid":"6.1b","version":"67'1","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407639+0000","last_change":"2024-09-15T03:27:31.124391+0000","last_active":"2024-09-15T03:28:05.407639+0000","last_peered":"2024-09-15T03:28:05.407639+0000","last_clean":"2024-09-15T03:28:05.407639+0000","last_became_active":"2024-09-15T03:27:31.123975+0000","last_became_peered":"2024-09-15T03:27:31.123975+0000","last_unstale":"2024-09-15T03:28:05.407639+0000","last_undegraded":"2024-09-15T03:28:05.407639+0000","last_fullsized":"2024-09-15T03:28:05.407639+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:57:12.231753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988372+0000","last_change":"2024-09-15T03:27:24.387137+0000","last_active":"2024-09-15T03:28:05.988372+0000","last_peered":"2024-09-15T03:28:05.988372+0000","last_clean":"2024-09-15T03:28:05.988372+0000","last_became_active":"2024-09-15T03:27:24.386535+0000","last_became_peered":"2024-09-15T03:27:24.386535+0000","last_unstale":"2024-09-15T03:28:05.988372+0000","last_undegraded":"2024-09-15T03:28:05.988372+0000","last_fullsized":"2024-09-15T03:28:05.988372+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:24:20.029808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'16","reported_seq":51,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408147+0000","last_change":"2024-09-15T03:27:26.657498+0000","last_active":"2024-09-15T03:28:05.408147+0000","last_peered":"2024-09-15T03:28:05.408147+0000","last_clean":"2024-09-15T03:28:05.408147+0000","last_became_active":"2024-09-15T03:27:26.657099+0000","last_became_peered":"2024-09-15T03:27:26.657099+0000","last_unstale":"2024-09-15T03:28:05.408147+0000","last_undegraded":"2024-09-15T03:28:05.408147+0000","last_fullsized":"2024-09-15T03:28:05.408147+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:57:09.115026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407693+0000","last_change":"2024-09-15T03:27:28.533310+0000","last_active":"2024-09-15T03:28:05.407693+0000","last_peered":"2024-09-15T03:28:05.407693+0000","last_clean":"2024-09-15T03:28:05.407693+0000","last_became_active":"2024-09-15T03:27:28.532419+0000","last_became_peered":"2024-09-15T03:27:28.532419+0000","last_unstale":"2024-09-15T03:28:05.407693+0000","last_undegraded":"2024-09-15T03:28:05.407693+0000","last_fullsized":"2024-09-15T03:28:05.407693+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:05:13.543627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408253+0000","last_change":"2024-09-15T03:27:24.384624+0000","last_active":"2024-09-15T03:28:05.408253+0000","last_peered":"2024-09-15T03:28:05.408253+0000","last_clean":"2024-09-15T03:28:05.408253+0000","last_became_active":"2024-09-15T03:27:24.384320+0000","last_became_peered":"2024-09-15T03:27:24.384320+0000","last_unstale":"2024-09-15T03:28:05.408253+0000","last_undegraded":"2024-09-15T03:28:05.408253+0000","last_fullsized":"2024-09-15T03:28:05.408253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:11:43.173507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'17","reported_seq":55,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988171+0000","last_change":"2024-09-15T03:27:26.653991+0000","last_active":"2024-09-15T03:28:05.988171+0000","last_peered":"2024-09-15T03:28:05.988171+0000","last_clean":"2024-09-15T03:28:05.988171+0000","last_became_active":"2024-09-15T03:27:26.653604+0000","last_became_peered":"2024-09-15T03:27:26.653604+0000","last_unstale":"2024-09-15T03:28:05.988171+0000","last_undegraded":"2024-09-15T03:28:05.988171+0000","last_fullsized":"2024-09-15T03:28:05.988171+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:08:30.623727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401603+0000","last_change":"2024-09-15T03:27:28.526746+0000","last_active":"2024-09-15T03:28:05.401603+0000","last_peered":"2024-09-15T03:28:05.401603+0000","last_clean":"2024-09-15T03:28:05.401603+0000","last_became_active":"2024-09-15T03:27:28.526416+0000","last_became_peered":"2024-09-15T03:27:28.526416+0000","last_unstale":"2024-09-15T03:28:05.401603+0000","last_undegraded":"2024-09-15T03:28:05.401603+0000","last_fullsized":"2024-09-15T03:28:05.401603+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:07:16.364725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401645+0000","last_change":"2024-09-15T03:27:30.553726+0000","last_active":"2024-09-15T03:28:05.401645+0000","last_peered":"2024-09-15T03:28:05.401645+0000","last_clean":"2024-09-15T03:28:05.401645+0000","last_became_active":"2024-09-15T03:27:30.553357+0000","last_became_peered":"2024-09-15T03:27:30.553357+0000","last_unstale":"2024-09-15T03:28:05.401645+0000","last_undegraded":"2024-09-15T03:28:05.401645+0000","last_fullsized":"2024-09-15T03:28:05.401645+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:47:00.932589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985647+0000","last_change":"2024-09-15T03:27:24.386635+0000","last_active":"2024-09-15T03:28:05.985647+0000","last_peered":"2024-09-15T03:28:05.985647+0000","last_clean":"2024-09-15T03:28:05.985647+0000","last_became_active":"2024-09-15T03:27:24.386334+0000","last_became_peered":"2024-09-15T03:27:24.386334+0000","last_unstale":"2024-09-15T03:28:05.985647+0000","last_undegraded":"2024-09-15T03:28:05.985647+0000","last_fullsized":"2024-09-15T03:28:05.985647+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:00:15.816788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":46,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405794+0000","last_change":"2024-09-15T03:27:26.395477+0000","last_active":"2024-09-15T03:28:05.405794+0000","last_peered":"2024-09-15T03:28:05.405794+0000","last_clean":"2024-09-15T03:28:05.405794+0000","last_became_active":"2024-09-15T03:27:26.395073+0000","last_became_peered":"2024-09-15T03:27:26.395073+0000","last_unstale":"2024-09-15T03:28:05.405794+0000","last_undegraded":"2024-09-15T03:28:05.405794+0000","last_fullsized":"2024-09-15T03:28:05.405794+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:32:21.977219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402049+0000","last_change":"2024-09-15T03:27:28.524089+0000","last_active":"2024-09-15T03:28:05.402049+0000","last_peered":"2024-09-15T03:28:05.402049+0000","last_clean":"2024-09-15T03:28:05.402049+0000","last_became_active":"2024-09-15T03:27:28.523748+0000","last_became_peered":"2024-09-15T03:27:28.523748+0000","last_unstale":"2024-09-15T03:28:05.402049+0000","last_undegraded":"2024-09-15T03:28:05.402049+0000","last_fullsized":"2024-09-15T03:28:05.402049+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:43:02.313736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405318+0000","last_change":"2024-09-15T03:27:30.559494+0000","last_active":"2024-09-15T03:28:05.405318+0000","last_peered":"2024-09-15T03:28:05.405318+0000","last_clean":"2024-09-15T03:28:05.405318+0000","last_became_active":"2024-09-15T03:27:30.559097+0000","last_became_peered":"2024-09-15T03:27:30.559097+0000","last_unstale":"2024-09-15T03:28:05.405318+0000","last_undegraded":"2024-09-15T03:28:05.405318+0000","last_fullsized":"2024-09-15T03:28:05.405318+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:52:14.678175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985737+0000","last_change":"2024-09-15T03:27:24.385619+0000","last_active":"2024-09-15T03:28:05.985737+0000","last_peered":"2024-09-15T03:28:05.985737+0000","last_clean":"2024-09-15T03:28:05.985737+0000","last_became_active":"2024-09-15T03:27:24.385309+0000","last_became_peered":"2024-09-15T03:27:24.385309+0000","last_unstale":"2024-09-15T03:28:05.985737+0000","last_undegraded":"2024-09-15T03:28:05.985737+0000","last_fullsized":"2024-09-15T03:28:05.985737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:59:20.001150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'18","reported_seq":59,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406300+0000","last_change":"2024-09-15T03:27:26.394989+0000","last_active":"2024-09-15T03:28:05.406300+0000","last_peered":"2024-09-15T03:28:05.406300+0000","last_clean":"2024-09-15T03:28:05.406300+0000","last_became_active":"2024-09-15T03:27:26.394559+0000","last_became_peered":"2024-09-15T03:27:26.394559+0000","last_unstale":"2024-09-15T03:28:05.406300+0000","last_undegraded":"2024-09-15T03:28:05.406300+0000","last_fullsized":"2024-09-15T03:28:05.406300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:42:40.184469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":27,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401968+0000","last_change":"2024-09-15T03:27:28.529771+0000","last_active":"2024-09-15T03:28:05.401968+0000","last_peered":"2024-09-15T03:28:05.401968+0000","last_clean":"2024-09-15T03:28:05.401968+0000","last_became_active":"2024-09-15T03:27:28.529441+0000","last_became_peered":"2024-09-15T03:27:28.529441+0000","last_unstale":"2024-09-15T03:28:05.401968+0000","last_undegraded":"2024-09-15T03:28:05.401968+0000","last_fullsized":"2024-09-15T03:28:05.401968+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:20:26.397510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987297+0000","last_change":"2024-09-15T03:27:30.553374+0000","last_active":"2024-09-15T03:28:05.987297+0000","last_peered":"2024-09-15T03:28:05.987297+0000","last_clean":"2024-09-15T03:28:05.987297+0000","last_became_active":"2024-09-15T03:27:30.552838+0000","last_became_peered":"2024-09-15T03:27:30.552838+0000","last_unstale":"2024-09-15T03:28:05.987297+0000","last_undegraded":"2024-09-15T03:28:05.987297+0000","last_fullsized":"2024-09-15T03:28:05.987297+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:38:54.642133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"67'25","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399178+0000","last_change":"2024-09-15T03:27:26.392755+0000","last_active":"2024-09-15T03:28:05.399178+0000","last_peered":"2024-09-15T03:28:05.399178+0000","last_clean":"2024-09-15T03:28:05.399178+0000","last_became_active":"2024-09-15T03:27:26.392476+0000","last_became_peered":"2024-09-15T03:27:26.392476+0000","last_unstale":"2024-09-15T03:28:05.399178+0000","last_undegraded":"2024-09-15T03:28:05.399178+0000","last_fullsized":"2024-09-15T03:28:05.399178+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:10:43.926169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":32,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985176+0000","last_change":"2024-09-15T03:27:24.385608+0000","last_active":"2024-09-15T03:28:05.985176+0000","last_peered":"2024-09-15T03:28:05.985176+0000","last_clean":"2024-09-15T03:28:05.985176+0000","last_became_active":"2024-09-15T03:27:24.385291+0000","last_became_peered":"2024-09-15T03:27:24.385291+0000","last_unstale":"2024-09-15T03:28:05.985176+0000","last_undegraded":"2024-09-15T03:28:05.985176+0000","last_fullsized":"2024-09-15T03:28:05.985176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:11:10.847992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"67'11","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.499047+0000","last_change":"2024-09-15T03:27:28.523932+0000","last_active":"2024-09-15T03:30:39.499047+0000","last_peered":"2024-09-15T03:30:39.499047+0000","last_clean":"2024-09-15T03:30:39.499047+0000","last_became_active":"2024-09-15T03:27:28.523628+0000","last_became_peered":"2024-09-15T03:27:28.523628+0000","last_unstale":"2024-09-15T03:30:39.499047+0000","last_undegraded":"2024-09-15T03:30:39.499047+0000","last_fullsized":"2024-09-15T03:30:39.499047+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:06:42.917795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405547+0000","last_change":"2024-09-15T03:27:30.560035+0000","last_active":"2024-09-15T03:28:05.405547+0000","last_peered":"2024-09-15T03:28:05.405547+0000","last_clean":"2024-09-15T03:28:05.405547+0000","last_became_active":"2024-09-15T03:27:30.559732+0000","last_became_peered":"2024-09-15T03:27:30.559732+0000","last_unstale":"2024-09-15T03:28:05.405547+0000","last_undegraded":"2024-09-15T03:28:05.405547+0000","last_fullsized":"2024-09-15T03:28:05.405547+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:25:25.073992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"67'15","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408243+0000","last_change":"2024-09-15T03:27:26.400699+0000","last_active":"2024-09-15T03:28:05.408243+0000","last_peered":"2024-09-15T03:28:05.408243+0000","last_clean":"2024-09-15T03:28:05.408243+0000","last_became_active":"2024-09-15T03:27:26.399984+0000","last_became_peered":"2024-09-15T03:27:26.399984+0000","last_unstale":"2024-09-15T03:28:05.408243+0000","last_undegraded":"2024-09-15T03:28:05.408243+0000","last_fullsized":"2024-09-15T03:28:05.408243+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:19:16.096839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402601+0000","last_change":"2024-09-15T03:27:24.389141+0000","last_active":"2024-09-15T03:28:05.402601+0000","last_peered":"2024-09-15T03:28:05.402601+0000","last_clean":"2024-09-15T03:28:05.402601+0000","last_became_active":"2024-09-15T03:27:24.388778+0000","last_became_peered":"2024-09-15T03:27:24.388778+0000","last_unstale":"2024-09-15T03:28:05.402601+0000","last_undegraded":"2024-09-15T03:28:05.402601+0000","last_fullsized":"2024-09-15T03:28:05.402601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:15:29.733096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402150+0000","last_change":"2024-09-15T03:27:28.530550+0000","last_active":"2024-09-15T03:28:05.402150+0000","last_peered":"2024-09-15T03:28:05.402150+0000","last_clean":"2024-09-15T03:28:05.402150+0000","last_became_active":"2024-09-15T03:27:28.530243+0000","last_became_peered":"2024-09-15T03:27:28.530243+0000","last_unstale":"2024-09-15T03:28:05.402150+0000","last_undegraded":"2024-09-15T03:28:05.402150+0000","last_fullsized":"2024-09-15T03:28:05.402150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:52:56.099120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402726+0000","last_change":"2024-09-15T03:27:30.554189+0000","last_active":"2024-09-15T03:28:05.402726+0000","last_peered":"2024-09-15T03:28:05.402726+0000","last_clean":"2024-09-15T03:28:05.402726+0000","last_became_active":"2024-09-15T03:27:30.553819+0000","last_became_peered":"2024-09-15T03:27:30.553819+0000","last_unstale":"2024-09-15T03:28:05.402726+0000","last_undegraded":"2024-09-15T03:28:05.402726+0000","last_fullsized":"2024-09-15T03:28:05.402726+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:01:13.881192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"67'27","reported_seq":76,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407868+0000","last_change":"2024-09-15T03:27:26.397091+0000","last_active":"2024-09-15T03:28:05.407868+0000","last_peered":"2024-09-15T03:28:05.407868+0000","last_clean":"2024-09-15T03:28:05.407868+0000","last_became_active":"2024-09-15T03:27:26.396728+0000","last_became_peered":"2024-09-15T03:27:26.396728+0000","last_unstale":"2024-09-15T03:28:05.407868+0000","last_undegraded":"2024-09-15T03:28:05.407868+0000","last_fullsized":"2024-09-15T03:28:05.407868+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:26:41.980014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401443+0000","last_change":"2024-09-15T03:27:24.388121+0000","last_active":"2024-09-15T03:28:05.401443+0000","last_peered":"2024-09-15T03:28:05.401443+0000","last_clean":"2024-09-15T03:28:05.401443+0000","last_became_active":"2024-09-15T03:27:24.387642+0000","last_became_peered":"2024-09-15T03:27:24.387642+0000","last_unstale":"2024-09-15T03:28:05.401443+0000","last_undegraded":"2024-09-15T03:28:05.401443+0000","last_fullsized":"2024-09-15T03:28:05.401443+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:01:37.490431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403424+0000","last_change":"2024-09-15T03:27:28.525766+0000","last_active":"2024-09-15T03:28:05.403424+0000","last_peered":"2024-09-15T03:28:05.403424+0000","last_clean":"2024-09-15T03:28:05.403424+0000","last_became_active":"2024-09-15T03:27:28.525481+0000","last_became_peered":"2024-09-15T03:27:28.525481+0000","last_unstale":"2024-09-15T03:28:05.403424+0000","last_undegraded":"2024-09-15T03:28:05.403424+0000","last_fullsized":"2024-09-15T03:28:05.403424+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:00:35.641647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405790+0000","last_change":"2024-09-15T03:27:30.559421+0000","last_active":"2024-09-15T03:28:05.405790+0000","last_peered":"2024-09-15T03:28:05.405790+0000","last_clean":"2024-09-15T03:28:05.405790+0000","last_became_active":"2024-09-15T03:27:30.559047+0000","last_became_peered":"2024-09-15T03:27:30.559047+0000","last_unstale":"2024-09-15T03:28:05.405790+0000","last_undegraded":"2024-09-15T03:28:05.405790+0000","last_fullsized":"2024-09-15T03:28:05.405790+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:09:12.644729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"67'24","reported_seq":74,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403118+0000","last_change":"2024-09-15T03:27:26.653270+0000","last_active":"2024-09-15T03:28:05.403118+0000","last_peered":"2024-09-15T03:28:05.403118+0000","last_clean":"2024-09-15T03:28:05.403118+0000","last_became_active":"2024-09-15T03:27:26.652480+0000","last_became_peered":"2024-09-15T03:27:26.652480+0000","last_unstale":"2024-09-15T03:28:05.403118+0000","last_undegraded":"2024-09-15T03:28:05.403118+0000","last_fullsized":"2024-09-15T03:28:05.403118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:40:15.477478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":38,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.986008+0000","last_change":"2024-09-15T03:27:24.388200+0000","last_active":"2024-09-15T03:28:05.986008+0000","last_peered":"2024-09-15T03:28:05.986008+0000","last_clean":"2024-09-15T03:28:05.986008+0000","last_became_active":"2024-09-15T03:27:24.387872+0000","last_became_peered":"2024-09-15T03:27:24.387872+0000","last_unstale":"2024-09-15T03:28:05.986008+0000","last_undegraded":"2024-09-15T03:28:05.986008+0000","last_fullsized":"2024-09-15T03:28:05.986008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:53:05.679841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"67'11","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.498896+0000","last_change":"2024-09-15T03:27:28.526874+0000","last_active":"2024-09-15T03:30:39.498896+0000","last_peered":"2024-09-15T03:30:39.498896+0000","last_clean":"2024-09-15T03:30:39.498896+0000","last_became_active":"2024-09-15T03:27:28.526590+0000","last_became_peered":"2024-09-15T03:27:28.526590+0000","last_unstale":"2024-09-15T03:30:39.498896+0000","last_undegraded":"2024-09-15T03:30:39.498896+0000","last_fullsized":"2024-09-15T03:30:39.498896+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:29:38.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407634+0000","last_change":"2024-09-15T03:27:31.123291+0000","last_active":"2024-09-15T03:28:05.407634+0000","last_peered":"2024-09-15T03:28:05.407634+0000","last_clean":"2024-09-15T03:28:05.407634+0000","last_became_active":"2024-09-15T03:27:31.122569+0000","last_became_peered":"2024-09-15T03:27:31.122569+0000","last_unstale":"2024-09-15T03:28:05.407634+0000","last_undegraded":"2024-09-15T03:28:05.407634+0000","last_fullsized":"2024-09-15T03:28:05.407634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:35:21.274687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":39,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988120+0000","last_change":"2024-09-15T03:27:26.399381+0000","last_active":"2024-09-15T03:28:05.988120+0000","last_peered":"2024-09-15T03:28:05.988120+0000","last_clean":"2024-09-15T03:28:05.988120+0000","last_became_active":"2024-09-15T03:27:26.399011+0000","last_became_peered":"2024-09-15T03:27:26.399011+0000","last_unstale":"2024-09-15T03:28:05.988120+0000","last_undegraded":"2024-09-15T03:28:05.988120+0000","last_fullsized":"2024-09-15T03:28:05.988120+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:53:27.461679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.400348+0000","last_change":"2024-09-15T03:27:24.385809+0000","last_active":"2024-09-15T03:28:05.400348+0000","last_peered":"2024-09-15T03:28:05.400348+0000","last_clean":"2024-09-15T03:28:05.400348+0000","last_became_active":"2024-09-15T03:27:24.385427+0000","last_became_peered":"2024-09-15T03:27:24.385427+0000","last_unstale":"2024-09-15T03:28:05.400348+0000","last_undegraded":"2024-09-15T03:28:05.400348+0000","last_fullsized":"2024-09-15T03:28:05.400348+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:00:16.899371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402957+0000","last_change":"2024-09-15T03:27:28.531584+0000","last_active":"2024-09-15T03:28:05.402957+0000","last_peered":"2024-09-15T03:28:05.402957+0000","last_clean":"2024-09-15T03:28:05.402957+0000","last_became_active":"2024-09-15T03:27:28.531141+0000","last_became_peered":"2024-09-15T03:27:28.531141+0000","last_unstale":"2024-09-15T03:28:05.402957+0000","last_undegraded":"2024-09-15T03:28:05.402957+0000","last_fullsized":"2024-09-15T03:28:05.402957+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:18:40.153533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"71'5","reported_seq":202,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:46.031206+0000","last_change":"2024-09-15T03:27:40.423193+0000","last_active":"2024-09-15T03:30:46.031206+0000","last_peered":"2024-09-15T03:30:46.031206+0000","last_clean":"2024-09-15T03:30:46.031206+0000","last_became_active":"2024-09-15T03:27:29.549624+0000","last_became_peered":"2024-09-15T03:27:29.549624+0000","last_unstale":"2024-09-15T03:30:46.031206+0000","last_undegraded":"2024-09-15T03:30:46.031206+0000","last_fullsized":"2024-09-15T03:30:46.031206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_clean_scrub_stamp":"2024-09-15T03:27:28.501254+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:42:16.242706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085985499999999997,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":176,"num_read_kb":171,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984722+0000","last_change":"2024-09-15T03:27:31.121765+0000","last_active":"2024-09-15T03:28:05.984722+0000","last_peered":"2024-09-15T03:28:05.984722+0000","last_clean":"2024-09-15T03:28:05.984722+0000","last_became_active":"2024-09-15T03:27:31.121174+0000","last_became_peered":"2024-09-15T03:27:31.121174+0000","last_unstale":"2024-09-15T03:28:05.984722+0000","last_undegraded":"2024-09-15T03:28:05.984722+0000","last_fullsized":"2024-09-15T03:28:05.984722+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:11:02.715916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.7","version":"67'19","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408442+0000","last_change":"2024-09-15T03:27:26.402846+0000","last_active":"2024-09-15T03:28:05.408442+0000","last_peered":"2024-09-15T03:28:05.408442+0000","last_clean":"2024-09-15T03:28:05.408442+0000","last_became_active":"2024-09-15T03:27:26.402527+0000","last_became_peered":"2024-09-15T03:27:26.402527+0000","last_unstale":"2024-09-15T03:28:05.408442+0000","last_undegraded":"2024-09-15T03:28:05.408442+0000","last_fullsized":"2024-09-15T03:28:05.408442+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:54:54.102693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":30,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403432+0000","last_change":"2024-09-15T03:27:24.379408+0000","last_active":"2024-09-15T03:28:05.403432+0000","last_peered":"2024-09-15T03:28:05.403432+0000","last_clean":"2024-09-15T03:28:05.403432+0000","last_became_active":"2024-09-15T03:27:24.379062+0000","last_became_peered":"2024-09-15T03:27:24.379062+0000","last_unstale":"2024-09-15T03:28:05.403432+0000","last_undegraded":"2024-09-15T03:28:05.403432+0000","last_fullsized":"2024-09-15T03:28:05.403432+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:09:02.012578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"67'11","reported_seq":74,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.501505+0000","last_change":"2024-09-15T03:27:28.533775+0000","last_active":"2024-09-15T03:30:39.501505+0000","last_peered":"2024-09-15T03:30:39.501505+0000","last_clean":"2024-09-15T03:30:39.501505+0000","last_became_active":"2024-09-15T03:27:28.532922+0000","last_became_peered":"2024-09-15T03:27:28.532922+0000","last_unstale":"2024-09-15T03:30:39.501505+0000","last_undegraded":"2024-09-15T03:30:39.501505+0000","last_fullsized":"2024-09-15T03:30:39.501505+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:33:56.128086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"68'1","reported_seq":24,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401746+0000","last_change":"2024-09-15T03:27:40.520355+0000","last_active":"2024-09-15T03:28:05.401746+0000","last_peered":"2024-09-15T03:28:05.401746+0000","last_clean":"2024-09-15T03:28:05.401746+0000","last_became_active":"2024-09-15T03:27:29.549223+0000","last_became_peered":"2024-09-15T03:27:29.549223+0000","last_unstale":"2024-09-15T03:28:05.401746+0000","last_undegraded":"2024-09-15T03:28:05.401746+0000","last_fullsized":"2024-09-15T03:28:05.401746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_clean_scrub_stamp":"2024-09-15T03:27:28.501254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:15:46.241441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014590720000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401863+0000","last_change":"2024-09-15T03:27:30.554412+0000","last_active":"2024-09-15T03:28:05.401863+0000","last_peered":"2024-09-15T03:28:05.401863+0000","last_clean":"2024-09-15T03:28:05.401863+0000","last_became_active":"2024-09-15T03:27:30.554055+0000","last_became_peered":"2024-09-15T03:27:30.554055+0000","last_unstale":"2024-09-15T03:28:05.401863+0000","last_undegraded":"2024-09-15T03:28:05.401863+0000","last_fullsized":"2024-09-15T03:28:05.401863+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:33:15.313425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"67'36","reported_seq":128,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.501154+0000","last_change":"2024-09-15T03:27:26.654345+0000","last_active":"2024-09-15T03:30:39.501154+0000","last_peered":"2024-09-15T03:30:39.501154+0000","last_clean":"2024-09-15T03:30:39.501154+0000","last_became_active":"2024-09-15T03:27:26.653831+0000","last_became_peered":"2024-09-15T03:27:26.653831+0000","last_unstale":"2024-09-15T03:30:39.501154+0000","last_undegraded":"2024-09-15T03:30:39.501154+0000","last_fullsized":"2024-09-15T03:30:39.501154+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:50:29.891157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":63,"num_read_kb":47,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"60'1","reported_seq":32,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985791+0000","last_change":"2024-09-15T03:27:24.387195+0000","last_active":"2024-09-15T03:28:05.985791+0000","last_peered":"2024-09-15T03:28:05.985791+0000","last_clean":"2024-09-15T03:28:05.985791+0000","last_became_active":"2024-09-15T03:27:24.386841+0000","last_became_peered":"2024-09-15T03:27:24.386841+0000","last_unstale":"2024-09-15T03:28:05.985791+0000","last_undegraded":"2024-09-15T03:28:05.985791+0000","last_fullsized":"2024-09-15T03:28:05.985791+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:22:10.723153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":362,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"67'11","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.501096+0000","last_change":"2024-09-15T03:27:28.532729+0000","last_active":"2024-09-15T03:30:39.501096+0000","last_peered":"2024-09-15T03:30:39.501096+0000","last_clean":"2024-09-15T03:30:39.501096+0000","last_became_active":"2024-09-15T03:27:28.532419+0000","last_became_peered":"2024-09-15T03:27:28.532419+0000","last_unstale":"2024-09-15T03:30:39.501096+0000","last_undegraded":"2024-09-15T03:30:39.501096+0000","last_fullsized":"2024-09-15T03:30:39.501096+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:41:03.621656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"70'2","reported_seq":25,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.398906+0000","last_change":"2024-09-15T03:27:40.194148+0000","last_active":"2024-09-15T03:28:05.398906+0000","last_peered":"2024-09-15T03:28:05.398906+0000","last_clean":"2024-09-15T03:28:05.398906+0000","last_became_active":"2024-09-15T03:27:29.548140+0000","last_became_peered":"2024-09-15T03:27:29.548140+0000","last_unstale":"2024-09-15T03:28:05.398906+0000","last_undegraded":"2024-09-15T03:28:05.398906+0000","last_fullsized":"2024-09-15T03:28:05.398906+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:28.501254+0000","last_clean_scrub_stamp":"2024-09-15T03:27:28.501254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:18:21.066206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020803229999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401031+0000","last_change":"2024-09-15T03:27:31.122766+0000","last_active":"2024-09-15T03:28:05.401031+0000","last_peered":"2024-09-15T03:28:05.401031+0000","last_clean":"2024-09-15T03:28:05.401031+0000","last_became_active":"2024-09-15T03:27:31.122242+0000","last_became_peered":"2024-09-15T03:27:31.122242+0000","last_unstale":"2024-09-15T03:28:05.401031+0000","last_undegraded":"2024-09-15T03:28:05.401031+0000","last_fullsized":"2024-09-15T03:28:05.401031+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:06:32.132362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'14","reported_seq":43,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406317+0000","last_change":"2024-09-15T03:27:26.655557+0000","last_active":"2024-09-15T03:28:05.406317+0000","last_peered":"2024-09-15T03:28:05.406317+0000","last_clean":"2024-09-15T03:28:05.406317+0000","last_became_active":"2024-09-15T03:27:26.655257+0000","last_became_peered":"2024-09-15T03:27:26.655257+0000","last_unstale":"2024-09-15T03:28:05.406317+0000","last_undegraded":"2024-09-15T03:28:05.406317+0000","last_fullsized":"2024-09-15T03:28:05.406317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:29:55.930182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403261+0000","last_change":"2024-09-15T03:27:24.388073+0000","last_active":"2024-09-15T03:28:05.403261+0000","last_peered":"2024-09-15T03:28:05.403261+0000","last_clean":"2024-09-15T03:28:05.403261+0000","last_became_active":"2024-09-15T03:27:24.387718+0000","last_became_peered":"2024-09-15T03:27:24.387718+0000","last_unstale":"2024-09-15T03:28:05.403261+0000","last_undegraded":"2024-09-15T03:28:05.403261+0000","last_fullsized":"2024-09-15T03:28:05.403261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:22:53.283921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401927+0000","last_change":"2024-09-15T03:27:28.525447+0000","last_active":"2024-09-15T03:28:05.401927+0000","last_peered":"2024-09-15T03:28:05.401927+0000","last_clean":"2024-09-15T03:28:05.401927+0000","last_became_active":"2024-09-15T03:27:28.524923+0000","last_became_peered":"2024-09-15T03:27:28.524923+0000","last_unstale":"2024-09-15T03:28:05.401927+0000","last_undegraded":"2024-09-15T03:28:05.401927+0000","last_fullsized":"2024-09-15T03:28:05.401927+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:10:19.733431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987569+0000","last_change":"2024-09-15T03:27:30.556113+0000","last_active":"2024-09-15T03:28:05.987569+0000","last_peered":"2024-09-15T03:28:05.987569+0000","last_clean":"2024-09-15T03:28:05.987569+0000","last_became_active":"2024-09-15T03:27:30.555690+0000","last_became_peered":"2024-09-15T03:27:30.555690+0000","last_unstale":"2024-09-15T03:28:05.987569+0000","last_undegraded":"2024-09-15T03:28:05.987569+0000","last_fullsized":"2024-09-15T03:28:05.987569+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:08:01.262857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"67'25","reported_seq":72,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402758+0000","last_change":"2024-09-15T03:27:26.392182+0000","last_active":"2024-09-15T03:28:05.402758+0000","last_peered":"2024-09-15T03:28:05.402758+0000","last_clean":"2024-09-15T03:28:05.402758+0000","last_became_active":"2024-09-15T03:27:26.391886+0000","last_became_peered":"2024-09-15T03:27:26.391886+0000","last_unstale":"2024-09-15T03:28:05.402758+0000","last_undegraded":"2024-09-15T03:28:05.402758+0000","last_fullsized":"2024-09-15T03:28:05.402758+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:03:03.205443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406008+0000","last_change":"2024-09-15T03:27:24.378809+0000","last_active":"2024-09-15T03:28:05.406008+0000","last_peered":"2024-09-15T03:28:05.406008+0000","last_clean":"2024-09-15T03:28:05.406008+0000","last_became_active":"2024-09-15T03:27:24.378511+0000","last_became_peered":"2024-09-15T03:27:24.378511+0000","last_unstale":"2024-09-15T03:28:05.406008+0000","last_undegraded":"2024-09-15T03:28:05.406008+0000","last_fullsized":"2024-09-15T03:28:05.406008+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:34:52.049009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402935+0000","last_change":"2024-09-15T03:27:28.526317+0000","last_active":"2024-09-15T03:28:05.402935+0000","last_peered":"2024-09-15T03:28:05.402935+0000","last_clean":"2024-09-15T03:28:05.402935+0000","last_became_active":"2024-09-15T03:27:28.526042+0000","last_became_peered":"2024-09-15T03:27:28.526042+0000","last_unstale":"2024-09-15T03:28:05.402935+0000","last_undegraded":"2024-09-15T03:28:05.402935+0000","last_fullsized":"2024-09-15T03:28:05.402935+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:12:29.259432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407778+0000","last_change":"2024-09-15T03:27:30.558815+0000","last_active":"2024-09-15T03:28:05.407778+0000","last_peered":"2024-09-15T03:28:05.407778+0000","last_clean":"2024-09-15T03:28:05.407778+0000","last_became_active":"2024-09-15T03:27:30.558480+0000","last_became_peered":"2024-09-15T03:27:30.558480+0000","last_unstale":"2024-09-15T03:28:05.407778+0000","last_undegraded":"2024-09-15T03:28:05.407778+0000","last_fullsized":"2024-09-15T03:28:05.407778+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:29:20.980341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"67'30","reported_seq":83,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401045+0000","last_change":"2024-09-15T03:27:26.655549+0000","last_active":"2024-09-15T03:28:05.401045+0000","last_peered":"2024-09-15T03:28:05.401045+0000","last_clean":"2024-09-15T03:28:05.401045+0000","last_became_active":"2024-09-15T03:27:26.654976+0000","last_became_peered":"2024-09-15T03:27:26.654976+0000","last_unstale":"2024-09-15T03:28:05.401045+0000","last_undegraded":"2024-09-15T03:28:05.401045+0000","last_fullsized":"2024-09-15T03:28:05.401045+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:07:43.434926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":44,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404824+0000","last_change":"2024-09-15T03:27:24.376072+0000","last_active":"2024-09-15T03:28:05.404824+0000","last_peered":"2024-09-15T03:28:05.404824+0000","last_clean":"2024-09-15T03:28:05.404824+0000","last_became_active":"2024-09-15T03:27:24.375632+0000","last_became_peered":"2024-09-15T03:27:24.375632+0000","last_unstale":"2024-09-15T03:28:05.404824+0000","last_undegraded":"2024-09-15T03:28:05.404824+0000","last_fullsized":"2024-09-15T03:28:05.404824+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:25:13.312604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.991523+0000","last_change":"2024-09-15T03:28:05.990679+0000","last_active":"2024-09-15T03:28:05.991523+0000","last_peered":"2024-09-15T03:28:05.991523+0000","last_clean":"2024-09-15T03:28:05.991523+0000","last_became_active":"2024-09-15T03:28:05.989536+0000","last_became_peered":"2024-09-15T03:28:05.989536+0000","last_unstale":"2024-09-15T03:28:05.991523+0000","last_undegraded":"2024-09-15T03:28:05.991523+0000","last_fullsized":"2024-09-15T03:28:05.991523+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:45:13.654223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985136+0000","last_change":"2024-09-15T03:27:31.121897+0000","last_active":"2024-09-15T03:28:05.985136+0000","last_peered":"2024-09-15T03:28:05.985136+0000","last_clean":"2024-09-15T03:28:05.985136+0000","last_became_active":"2024-09-15T03:27:31.121367+0000","last_became_peered":"2024-09-15T03:27:31.121367+0000","last_unstale":"2024-09-15T03:28:05.985136+0000","last_undegraded":"2024-09-15T03:28:05.985136+0000","last_fullsized":"2024-09-15T03:28:05.985136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:12:53.456711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"67'20","reported_seq":57,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987224+0000","last_change":"2024-09-15T03:27:26.399394+0000","last_active":"2024-09-15T03:28:05.987224+0000","last_peered":"2024-09-15T03:28:05.987224+0000","last_clean":"2024-09-15T03:28:05.987224+0000","last_became_active":"2024-09-15T03:27:26.398994+0000","last_became_peered":"2024-09-15T03:27:26.398994+0000","last_unstale":"2024-09-15T03:28:05.987224+0000","last_undegraded":"2024-09-15T03:28:05.987224+0000","last_fullsized":"2024-09-15T03:28:05.987224+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:34:35.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.990930+0000","last_change":"2024-09-15T03:28:05.990054+0000","last_active":"2024-09-15T03:28:05.990930+0000","last_peered":"2024-09-15T03:28:05.990930+0000","last_clean":"2024-09-15T03:28:05.990930+0000","last_became_active":"2024-09-15T03:28:05.989475+0000","last_became_peered":"2024-09-15T03:28:05.989475+0000","last_unstale":"2024-09-15T03:28:05.990930+0000","last_undegraded":"2024-09-15T03:28:05.990930+0000","last_fullsized":"2024-09-15T03:28:05.990930+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:20:45.603459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988098+0000","last_change":"2024-09-15T03:27:28.529994+0000","last_active":"2024-09-15T03:28:05.988098+0000","last_peered":"2024-09-15T03:28:05.988098+0000","last_clean":"2024-09-15T03:28:05.988098+0000","last_became_active":"2024-09-15T03:27:28.529659+0000","last_became_peered":"2024-09-15T03:27:28.529659+0000","last_unstale":"2024-09-15T03:28:05.988098+0000","last_undegraded":"2024-09-15T03:28:05.988098+0000","last_fullsized":"2024-09-15T03:28:05.988098+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:15:27.673663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401213+0000","last_change":"2024-09-15T03:27:30.561436+0000","last_active":"2024-09-15T03:28:05.401213+0000","last_peered":"2024-09-15T03:28:05.401213+0000","last_clean":"2024-09-15T03:28:05.401213+0000","last_became_active":"2024-09-15T03:27:30.560981+0000","last_became_peered":"2024-09-15T03:27:30.560981+0000","last_unstale":"2024-09-15T03:28:05.401213+0000","last_undegraded":"2024-09-15T03:28:05.401213+0000","last_fullsized":"2024-09-15T03:28:05.401213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:08:49.178545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"67'16","reported_seq":51,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407455+0000","last_change":"2024-09-15T03:27:26.396962+0000","last_active":"2024-09-15T03:28:05.407455+0000","last_peered":"2024-09-15T03:28:05.407455+0000","last_clean":"2024-09-15T03:28:05.407455+0000","last_became_active":"2024-09-15T03:27:26.396242+0000","last_became_peered":"2024-09-15T03:27:26.396242+0000","last_unstale":"2024-09-15T03:28:05.407455+0000","last_undegraded":"2024-09-15T03:28:05.407455+0000","last_fullsized":"2024-09-15T03:28:05.407455+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:45:12.136881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405880+0000","last_change":"2024-09-15T03:27:24.384607+0000","last_active":"2024-09-15T03:28:05.405880+0000","last_peered":"2024-09-15T03:28:05.405880+0000","last_clean":"2024-09-15T03:28:05.405880+0000","last_became_active":"2024-09-15T03:27:24.384270+0000","last_became_peered":"2024-09-15T03:27:24.384270+0000","last_unstale":"2024-09-15T03:28:05.405880+0000","last_undegraded":"2024-09-15T03:28:05.405880+0000","last_fullsized":"2024-09-15T03:28:05.405880+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:19:30.643816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"74'139","reported_seq":276,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:28:29.103105+0000","last_change":"2024-09-15T03:26:45.151917+0000","last_active":"2024-09-15T03:28:29.103105+0000","last_peered":"2024-09-15T03:28:29.103105+0000","last_clean":"2024-09-15T03:28:29.103105+0000","last_became_active":"2024-09-15T03:26:45.150693+0000","last_became_peered":"2024-09-15T03:26:45.150693+0000","last_unstale":"2024-09-15T03:28:29.103105+0000","last_undegraded":"2024-09-15T03:28:29.103105+0000","last_fullsized":"2024-09-15T03:28:29.103105+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:21:44.219763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:21:44.219763+0000","last_clean_scrub_stamp":"2024-09-15T03:21:44.219763+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:20:32.237730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":258,"num_write":179,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399699+0000","last_change":"2024-09-15T03:27:28.532949+0000","last_active":"2024-09-15T03:28:05.399699+0000","last_peered":"2024-09-15T03:28:05.399699+0000","last_clean":"2024-09-15T03:28:05.399699+0000","last_became_active":"2024-09-15T03:27:28.532658+0000","last_became_peered":"2024-09-15T03:27:28.532658+0000","last_unstale":"2024-09-15T03:28:05.399699+0000","last_undegraded":"2024-09-15T03:28:05.399699+0000","last_fullsized":"2024-09-15T03:28:05.399699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:07:56.259835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406104+0000","last_change":"2024-09-15T03:27:30.558032+0000","last_active":"2024-09-15T03:28:05.406104+0000","last_peered":"2024-09-15T03:28:05.406104+0000","last_clean":"2024-09-15T03:28:05.406104+0000","last_became_active":"2024-09-15T03:27:30.557642+0000","last_became_peered":"2024-09-15T03:27:30.557642+0000","last_unstale":"2024-09-15T03:28:05.406104+0000","last_undegraded":"2024-09-15T03:28:05.406104+0000","last_fullsized":"2024-09-15T03:28:05.406104+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:54:45.242731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":49,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985508+0000","last_change":"2024-09-15T03:27:26.394691+0000","last_active":"2024-09-15T03:28:05.985508+0000","last_peered":"2024-09-15T03:28:05.985508+0000","last_clean":"2024-09-15T03:28:05.985508+0000","last_became_active":"2024-09-15T03:27:26.394222+0000","last_became_peered":"2024-09-15T03:27:26.394222+0000","last_unstale":"2024-09-15T03:28:05.985508+0000","last_undegraded":"2024-09-15T03:28:05.985508+0000","last_fullsized":"2024-09-15T03:28:05.985508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:18:28.297603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405363+0000","last_change":"2024-09-15T03:27:24.385647+0000","last_active":"2024-09-15T03:28:05.405363+0000","last_peered":"2024-09-15T03:28:05.405363+0000","last_clean":"2024-09-15T03:28:05.405363+0000","last_became_active":"2024-09-15T03:27:24.385218+0000","last_became_peered":"2024-09-15T03:27:24.385218+0000","last_unstale":"2024-09-15T03:28:05.405363+0000","last_undegraded":"2024-09-15T03:28:05.405363+0000","last_fullsized":"2024-09-15T03:28:05.405363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:02:09.538720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.398990+0000","last_change":"2024-09-15T03:27:28.529607+0000","last_active":"2024-09-15T03:28:05.398990+0000","last_peered":"2024-09-15T03:28:05.398990+0000","last_clean":"2024-09-15T03:28:05.398990+0000","last_became_active":"2024-09-15T03:27:28.529321+0000","last_became_peered":"2024-09-15T03:27:28.529321+0000","last_unstale":"2024-09-15T03:28:05.398990+0000","last_undegraded":"2024-09-15T03:28:05.398990+0000","last_fullsized":"2024-09-15T03:28:05.398990+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:22:47.454093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.986119+0000","last_change":"2024-09-15T03:27:30.552499+0000","last_active":"2024-09-15T03:28:05.986119+0000","last_peered":"2024-09-15T03:28:05.986119+0000","last_clean":"2024-09-15T03:28:05.986119+0000","last_became_active":"2024-09-15T03:27:30.552199+0000","last_became_peered":"2024-09-15T03:27:30.552199+0000","last_unstale":"2024-09-15T03:28:05.986119+0000","last_undegraded":"2024-09-15T03:28:05.986119+0000","last_fullsized":"2024-09-15T03:28:05.986119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:34:53.128751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":36,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405899+0000","last_change":"2024-09-15T03:27:26.392459+0000","last_active":"2024-09-15T03:28:05.405899+0000","last_peered":"2024-09-15T03:28:05.405899+0000","last_clean":"2024-09-15T03:28:05.405899+0000","last_became_active":"2024-09-15T03:27:26.391656+0000","last_became_peered":"2024-09-15T03:27:26.391656+0000","last_unstale":"2024-09-15T03:28:05.405899+0000","last_undegraded":"2024-09-15T03:28:05.405899+0000","last_fullsized":"2024-09-15T03:28:05.405899+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:28:09.504685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403600+0000","last_change":"2024-09-15T03:27:24.378229+0000","last_active":"2024-09-15T03:28:05.403600+0000","last_peered":"2024-09-15T03:28:05.403600+0000","last_clean":"2024-09-15T03:28:05.403600+0000","last_became_active":"2024-09-15T03:27:24.377366+0000","last_became_peered":"2024-09-15T03:27:24.377366+0000","last_unstale":"2024-09-15T03:28:05.403600+0000","last_undegraded":"2024-09-15T03:28:05.403600+0000","last_fullsized":"2024-09-15T03:28:05.403600+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:46:58.012563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987381+0000","last_change":"2024-09-15T03:27:28.529409+0000","last_active":"2024-09-15T03:28:05.987381+0000","last_peered":"2024-09-15T03:28:05.987381+0000","last_clean":"2024-09-15T03:28:05.987381+0000","last_became_active":"2024-09-15T03:27:28.529101+0000","last_became_peered":"2024-09-15T03:27:28.529101+0000","last_unstale":"2024-09-15T03:28:05.987381+0000","last_undegraded":"2024-09-15T03:28:05.987381+0000","last_fullsized":"2024-09-15T03:28:05.987381+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:54:13.109615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987103+0000","last_change":"2024-09-15T03:27:30.557182+0000","last_active":"2024-09-15T03:28:05.987103+0000","last_peered":"2024-09-15T03:28:05.987103+0000","last_clean":"2024-09-15T03:28:05.987103+0000","last_became_active":"2024-09-15T03:27:30.556596+0000","last_became_peered":"2024-09-15T03:27:30.556596+0000","last_unstale":"2024-09-15T03:28:05.987103+0000","last_undegraded":"2024-09-15T03:28:05.987103+0000","last_fullsized":"2024-09-15T03:28:05.987103+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:14:25.209913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":46,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985505+0000","last_change":"2024-09-15T03:27:26.399841+0000","last_active":"2024-09-15T03:28:05.985505+0000","last_peered":"2024-09-15T03:28:05.985505+0000","last_clean":"2024-09-15T03:28:05.985505+0000","last_became_active":"2024-09-15T03:27:26.399488+0000","last_became_peered":"2024-09-15T03:27:26.399488+0000","last_unstale":"2024-09-15T03:28:05.985505+0000","last_undegraded":"2024-09-15T03:28:05.985505+0000","last_fullsized":"2024-09-15T03:28:05.985505+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:25:23.943773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405453+0000","last_change":"2024-09-15T03:27:24.385651+0000","last_active":"2024-09-15T03:28:05.405453+0000","last_peered":"2024-09-15T03:28:05.405453+0000","last_clean":"2024-09-15T03:28:05.405453+0000","last_became_active":"2024-09-15T03:27:24.385258+0000","last_became_peered":"2024-09-15T03:27:24.385258+0000","last_unstale":"2024-09-15T03:28:05.405453+0000","last_undegraded":"2024-09-15T03:28:05.405453+0000","last_fullsized":"2024-09-15T03:28:05.405453+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:24:12.475805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404965+0000","last_change":"2024-09-15T03:27:28.527614+0000","last_active":"2024-09-15T03:28:05.404965+0000","last_peered":"2024-09-15T03:28:05.404965+0000","last_clean":"2024-09-15T03:28:05.404965+0000","last_became_active":"2024-09-15T03:27:28.527304+0000","last_became_peered":"2024-09-15T03:27:28.527304+0000","last_unstale":"2024-09-15T03:28:05.404965+0000","last_undegraded":"2024-09-15T03:28:05.404965+0000","last_fullsized":"2024-09-15T03:28:05.404965+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:41:32.831346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405471+0000","last_change":"2024-09-15T03:27:31.123250+0000","last_active":"2024-09-15T03:28:05.405471+0000","last_peered":"2024-09-15T03:28:05.405471+0000","last_clean":"2024-09-15T03:28:05.405471+0000","last_became_active":"2024-09-15T03:27:31.122791+0000","last_became_peered":"2024-09-15T03:27:31.122791+0000","last_unstale":"2024-09-15T03:28:05.405471+0000","last_undegraded":"2024-09-15T03:28:05.405471+0000","last_fullsized":"2024-09-15T03:28:05.405471+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:18:34.416447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"67'17","reported_seq":55,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985745+0000","last_change":"2024-09-15T03:27:26.397467+0000","last_active":"2024-09-15T03:28:05.985745+0000","last_peered":"2024-09-15T03:28:05.985745+0000","last_clean":"2024-09-15T03:28:05.985745+0000","last_became_active":"2024-09-15T03:27:26.397017+0000","last_became_peered":"2024-09-15T03:27:26.397017+0000","last_unstale":"2024-09-15T03:28:05.985745+0000","last_undegraded":"2024-09-15T03:28:05.985745+0000","last_fullsized":"2024-09-15T03:28:05.985745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:46:01.389990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403309+0000","last_change":"2024-09-15T03:27:24.383098+0000","last_active":"2024-09-15T03:28:05.403309+0000","last_peered":"2024-09-15T03:28:05.403309+0000","last_clean":"2024-09-15T03:28:05.403309+0000","last_became_active":"2024-09-15T03:27:24.382728+0000","last_became_peered":"2024-09-15T03:27:24.382728+0000","last_unstale":"2024-09-15T03:28:05.403309+0000","last_undegraded":"2024-09-15T03:28:05.403309+0000","last_fullsized":"2024-09-15T03:28:05.403309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:30:16.946649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"73'12","reported_seq":86,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.499185+0000","last_change":"2024-09-15T03:28:05.409916+0000","last_active":"2024-09-15T03:30:39.499185+0000","last_peered":"2024-09-15T03:30:39.499185+0000","last_clean":"2024-09-15T03:30:39.499185+0000","last_became_active":"2024-09-15T03:28:05.406952+0000","last_became_peered":"2024-09-15T03:28:05.406952+0000","last_unstale":"2024-09-15T03:30:39.499185+0000","last_undegraded":"2024-09-15T03:30:39.499185+0000","last_fullsized":"2024-09-15T03:30:39.499185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:54:09.061884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407667+0000","last_change":"2024-09-15T03:27:30.561579+0000","last_active":"2024-09-15T03:28:05.407667+0000","last_peered":"2024-09-15T03:28:05.407667+0000","last_clean":"2024-09-15T03:28:05.407667+0000","last_became_active":"2024-09-15T03:27:30.561314+0000","last_became_peered":"2024-09-15T03:27:30.561314+0000","last_unstale":"2024-09-15T03:28:05.407667+0000","last_undegraded":"2024-09-15T03:28:05.407667+0000","last_fullsized":"2024-09-15T03:28:05.407667+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:36:26.535500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"67'17","reported_seq":55,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984736+0000","last_change":"2024-09-15T03:27:26.398391+0000","last_active":"2024-09-15T03:28:05.984736+0000","last_peered":"2024-09-15T03:28:05.984736+0000","last_clean":"2024-09-15T03:28:05.984736+0000","last_became_active":"2024-09-15T03:27:26.398100+0000","last_became_peered":"2024-09-15T03:27:26.398100+0000","last_unstale":"2024-09-15T03:28:05.984736+0000","last_undegraded":"2024-09-15T03:28:05.984736+0000","last_fullsized":"2024-09-15T03:28:05.984736+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:12:25.144342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404789+0000","last_change":"2024-09-15T03:27:24.386294+0000","last_active":"2024-09-15T03:28:05.404789+0000","last_peered":"2024-09-15T03:28:05.404789+0000","last_clean":"2024-09-15T03:28:05.404789+0000","last_became_active":"2024-09-15T03:27:24.385890+0000","last_became_peered":"2024-09-15T03:27:24.385890+0000","last_unstale":"2024-09-15T03:28:05.404789+0000","last_undegraded":"2024-09-15T03:28:05.404789+0000","last_fullsized":"2024-09-15T03:28:05.404789+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:19:48.004389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987890+0000","last_change":"2024-09-15T03:27:28.530524+0000","last_active":"2024-09-15T03:28:05.987890+0000","last_peered":"2024-09-15T03:28:05.987890+0000","last_clean":"2024-09-15T03:28:05.987890+0000","last_became_active":"2024-09-15T03:27:28.530283+0000","last_became_peered":"2024-09-15T03:27:28.530283+0000","last_unstale":"2024-09-15T03:28:05.987890+0000","last_undegraded":"2024-09-15T03:28:05.987890+0000","last_fullsized":"2024-09-15T03:28:05.987890+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:54:36.277563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.404887+0000","last_change":"2024-09-15T03:27:30.559315+0000","last_active":"2024-09-15T03:28:05.404887+0000","last_peered":"2024-09-15T03:28:05.404887+0000","last_clean":"2024-09-15T03:28:05.404887+0000","last_became_active":"2024-09-15T03:27:30.559019+0000","last_became_peered":"2024-09-15T03:27:30.559019+0000","last_unstale":"2024-09-15T03:28:05.404887+0000","last_undegraded":"2024-09-15T03:28:05.404887+0000","last_fullsized":"2024-09-15T03:28:05.404887+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:53:11.452148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":27,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399019+0000","last_change":"2024-09-15T03:27:26.392079+0000","last_active":"2024-09-15T03:28:05.399019+0000","last_peered":"2024-09-15T03:28:05.399019+0000","last_clean":"2024-09-15T03:28:05.399019+0000","last_became_active":"2024-09-15T03:27:26.391766+0000","last_became_peered":"2024-09-15T03:27:26.391766+0000","last_unstale":"2024-09-15T03:28:05.399019+0000","last_undegraded":"2024-09-15T03:28:05.399019+0000","last_fullsized":"2024-09-15T03:28:05.399019+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:46:18.139767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.398996+0000","last_change":"2024-09-15T03:27:24.378466+0000","last_active":"2024-09-15T03:28:05.398996+0000","last_peered":"2024-09-15T03:28:05.398996+0000","last_clean":"2024-09-15T03:28:05.398996+0000","last_became_active":"2024-09-15T03:27:24.378127+0000","last_became_peered":"2024-09-15T03:27:24.378127+0000","last_unstale":"2024-09-15T03:28:05.398996+0000","last_undegraded":"2024-09-15T03:28:05.398996+0000","last_fullsized":"2024-09-15T03:28:05.398996+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:45:19.153341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408276+0000","last_change":"2024-09-15T03:27:28.532606+0000","last_active":"2024-09-15T03:28:05.408276+0000","last_peered":"2024-09-15T03:28:05.408276+0000","last_clean":"2024-09-15T03:28:05.408276+0000","last_became_active":"2024-09-15T03:27:28.532307+0000","last_became_peered":"2024-09-15T03:27:28.532307+0000","last_unstale":"2024-09-15T03:28:05.408276+0000","last_undegraded":"2024-09-15T03:28:05.408276+0000","last_fullsized":"2024-09-15T03:28:05.408276+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:19:00.752132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984938+0000","last_change":"2024-09-15T03:27:31.123259+0000","last_active":"2024-09-15T03:28:05.984938+0000","last_peered":"2024-09-15T03:28:05.984938+0000","last_clean":"2024-09-15T03:28:05.984938+0000","last_became_active":"2024-09-15T03:27:31.122752+0000","last_became_peered":"2024-09-15T03:27:31.122752+0000","last_unstale":"2024-09-15T03:28:05.984938+0000","last_undegraded":"2024-09-15T03:28:05.984938+0000","last_fullsized":"2024-09-15T03:28:05.984938+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:53:29.153135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":40,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985027+0000","last_change":"2024-09-15T03:27:26.653044+0000","last_active":"2024-09-15T03:28:05.985027+0000","last_peered":"2024-09-15T03:28:05.985027+0000","last_clean":"2024-09-15T03:28:05.985027+0000","last_became_active":"2024-09-15T03:27:26.652134+0000","last_became_peered":"2024-09-15T03:27:26.652134+0000","last_unstale":"2024-09-15T03:28:05.985027+0000","last_undegraded":"2024-09-15T03:28:05.985027+0000","last_fullsized":"2024-09-15T03:28:05.985027+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:24:19.191551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406170+0000","last_change":"2024-09-15T03:27:24.384571+0000","last_active":"2024-09-15T03:28:05.406170+0000","last_peered":"2024-09-15T03:28:05.406170+0000","last_clean":"2024-09-15T03:28:05.406170+0000","last_became_active":"2024-09-15T03:27:24.383975+0000","last_became_peered":"2024-09-15T03:27:24.383975+0000","last_unstale":"2024-09-15T03:28:05.406170+0000","last_undegraded":"2024-09-15T03:28:05.406170+0000","last_fullsized":"2024-09-15T03:28:05.406170+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:54:52.064126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"67'11","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.501522+0000","last_change":"2024-09-15T03:27:28.531909+0000","last_active":"2024-09-15T03:30:39.501522+0000","last_peered":"2024-09-15T03:30:39.501522+0000","last_clean":"2024-09-15T03:30:39.501522+0000","last_became_active":"2024-09-15T03:27:28.531599+0000","last_became_peered":"2024-09-15T03:27:28.531599+0000","last_unstale":"2024-09-15T03:30:39.501522+0000","last_undegraded":"2024-09-15T03:30:39.501522+0000","last_fullsized":"2024-09-15T03:30:39.501522+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:42:27.896011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987861+0000","last_change":"2024-09-15T03:27:30.557113+0000","last_active":"2024-09-15T03:28:05.987861+0000","last_peered":"2024-09-15T03:28:05.987861+0000","last_clean":"2024-09-15T03:28:05.987861+0000","last_became_active":"2024-09-15T03:27:30.556769+0000","last_became_peered":"2024-09-15T03:27:30.556769+0000","last_unstale":"2024-09-15T03:28:05.987861+0000","last_undegraded":"2024-09-15T03:28:05.987861+0000","last_fullsized":"2024-09-15T03:28:05.987861+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:57:18.883643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":37,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987687+0000","last_change":"2024-09-15T03:27:26.396388+0000","last_active":"2024-09-15T03:28:05.987687+0000","last_peered":"2024-09-15T03:28:05.987687+0000","last_clean":"2024-09-15T03:28:05.987687+0000","last_became_active":"2024-09-15T03:27:26.395965+0000","last_became_peered":"2024-09-15T03:27:26.395965+0000","last_unstale":"2024-09-15T03:28:05.987687+0000","last_undegraded":"2024-09-15T03:28:05.987687+0000","last_fullsized":"2024-09-15T03:28:05.987687+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:42:17.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988307+0000","last_change":"2024-09-15T03:27:24.384550+0000","last_active":"2024-09-15T03:28:05.988307+0000","last_peered":"2024-09-15T03:28:05.988307+0000","last_clean":"2024-09-15T03:28:05.988307+0000","last_became_active":"2024-09-15T03:27:24.384162+0000","last_became_peered":"2024-09-15T03:27:24.384162+0000","last_unstale":"2024-09-15T03:28:05.988307+0000","last_undegraded":"2024-09-15T03:28:05.988307+0000","last_fullsized":"2024-09-15T03:28:05.988307+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:46:41.627891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"67'11","reported_seq":71,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.498884+0000","last_change":"2024-09-15T03:27:28.530401+0000","last_active":"2024-09-15T03:30:39.498884+0000","last_peered":"2024-09-15T03:30:39.498884+0000","last_clean":"2024-09-15T03:30:39.498884+0000","last_became_active":"2024-09-15T03:27:28.530103+0000","last_became_peered":"2024-09-15T03:27:28.530103+0000","last_unstale":"2024-09-15T03:30:39.498884+0000","last_undegraded":"2024-09-15T03:30:39.498884+0000","last_fullsized":"2024-09-15T03:30:39.498884+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:26:37.412515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403189+0000","last_change":"2024-09-15T03:27:30.555631+0000","last_active":"2024-09-15T03:28:05.403189+0000","last_peered":"2024-09-15T03:28:05.403189+0000","last_clean":"2024-09-15T03:28:05.403189+0000","last_became_active":"2024-09-15T03:27:30.555324+0000","last_became_peered":"2024-09-15T03:27:30.555324+0000","last_unstale":"2024-09-15T03:28:05.403189+0000","last_undegraded":"2024-09-15T03:28:05.403189+0000","last_fullsized":"2024-09-15T03:28:05.403189+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:42:41.560322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"67'15","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985277+0000","last_change":"2024-09-15T03:27:26.397456+0000","last_active":"2024-09-15T03:28:05.985277+0000","last_peered":"2024-09-15T03:28:05.985277+0000","last_clean":"2024-09-15T03:28:05.985277+0000","last_became_active":"2024-09-15T03:27:26.397117+0000","last_became_peered":"2024-09-15T03:27:26.397117+0000","last_unstale":"2024-09-15T03:28:05.985277+0000","last_undegraded":"2024-09-15T03:28:05.985277+0000","last_fullsized":"2024-09-15T03:28:05.985277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:57:07.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399570+0000","last_change":"2024-09-15T03:27:24.381126+0000","last_active":"2024-09-15T03:28:05.399570+0000","last_peered":"2024-09-15T03:28:05.399570+0000","last_clean":"2024-09-15T03:28:05.399570+0000","last_became_active":"2024-09-15T03:27:24.380849+0000","last_became_peered":"2024-09-15T03:27:24.380849+0000","last_unstale":"2024-09-15T03:28:05.399570+0000","last_undegraded":"2024-09-15T03:28:05.399570+0000","last_fullsized":"2024-09-15T03:28:05.399570+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:53:45.651768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402189+0000","last_change":"2024-09-15T03:27:28.525206+0000","last_active":"2024-09-15T03:28:05.402189+0000","last_peered":"2024-09-15T03:28:05.402189+0000","last_clean":"2024-09-15T03:28:05.402189+0000","last_became_active":"2024-09-15T03:27:28.524485+0000","last_became_peered":"2024-09-15T03:27:28.524485+0000","last_unstale":"2024-09-15T03:28:05.402189+0000","last_undegraded":"2024-09-15T03:28:05.402189+0000","last_fullsized":"2024-09-15T03:28:05.402189+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:52:28.137570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987032+0000","last_change":"2024-09-15T03:27:30.553160+0000","last_active":"2024-09-15T03:28:05.987032+0000","last_peered":"2024-09-15T03:28:05.987032+0000","last_clean":"2024-09-15T03:28:05.987032+0000","last_became_active":"2024-09-15T03:27:30.552441+0000","last_became_peered":"2024-09-15T03:27:30.552441+0000","last_unstale":"2024-09-15T03:28:05.987032+0000","last_undegraded":"2024-09-15T03:28:05.987032+0000","last_fullsized":"2024-09-15T03:28:05.987032+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:42:02.707852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"67'23","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402370+0000","last_change":"2024-09-15T03:27:26.400026+0000","last_active":"2024-09-15T03:28:05.402370+0000","last_peered":"2024-09-15T03:28:05.402370+0000","last_clean":"2024-09-15T03:28:05.402370+0000","last_became_active":"2024-09-15T03:27:26.399663+0000","last_became_peered":"2024-09-15T03:27:26.399663+0000","last_unstale":"2024-09-15T03:28:05.402370+0000","last_undegraded":"2024-09-15T03:28:05.402370+0000","last_fullsized":"2024-09-15T03:28:05.402370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T10:41:57.103303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":32,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403437+0000","last_change":"2024-09-15T03:27:24.388917+0000","last_active":"2024-09-15T03:28:05.403437+0000","last_peered":"2024-09-15T03:28:05.403437+0000","last_clean":"2024-09-15T03:28:05.403437+0000","last_became_active":"2024-09-15T03:27:24.388593+0000","last_became_peered":"2024-09-15T03:27:24.388593+0000","last_unstale":"2024-09-15T03:28:05.403437+0000","last_undegraded":"2024-09-15T03:28:05.403437+0000","last_fullsized":"2024-09-15T03:28:05.403437+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:49:13.735144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402183+0000","last_change":"2024-09-15T03:27:28.521072+0000","last_active":"2024-09-15T03:28:05.402183+0000","last_peered":"2024-09-15T03:28:05.402183+0000","last_clean":"2024-09-15T03:28:05.402183+0000","last_became_active":"2024-09-15T03:27:28.520707+0000","last_became_peered":"2024-09-15T03:27:28.520707+0000","last_unstale":"2024-09-15T03:28:05.402183+0000","last_undegraded":"2024-09-15T03:28:05.402183+0000","last_fullsized":"2024-09-15T03:28:05.402183+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T04:21:30.862258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407008+0000","last_change":"2024-09-15T03:27:30.556332+0000","last_active":"2024-09-15T03:28:05.407008+0000","last_peered":"2024-09-15T03:28:05.407008+0000","last_clean":"2024-09-15T03:28:05.407008+0000","last_became_active":"2024-09-15T03:27:30.555391+0000","last_became_peered":"2024-09-15T03:27:30.555391+0000","last_unstale":"2024-09-15T03:28:05.407008+0000","last_undegraded":"2024-09-15T03:28:05.407008+0000","last_fullsized":"2024-09-15T03:28:05.407008+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:07:22.902408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"67'12","reported_seq":45,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988347+0000","last_change":"2024-09-15T03:27:26.398405+0000","last_active":"2024-09-15T03:28:05.988347+0000","last_peered":"2024-09-15T03:28:05.988347+0000","last_clean":"2024-09-15T03:28:05.988347+0000","last_became_active":"2024-09-15T03:27:26.398071+0000","last_became_peered":"2024-09-15T03:27:26.398071+0000","last_unstale":"2024-09-15T03:28:05.988347+0000","last_undegraded":"2024-09-15T03:28:05.988347+0000","last_fullsized":"2024-09-15T03:28:05.988347+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:05:41.955098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"60'1","reported_seq":34,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406189+0000","last_change":"2024-09-15T03:27:24.379552+0000","last_active":"2024-09-15T03:28:05.406189+0000","last_peered":"2024-09-15T03:28:05.406189+0000","last_clean":"2024-09-15T03:28:05.406189+0000","last_became_active":"2024-09-15T03:27:24.379231+0000","last_became_peered":"2024-09-15T03:27:24.379231+0000","last_unstale":"2024-09-15T03:28:05.406189+0000","last_undegraded":"2024-09-15T03:28:05.406189+0000","last_fullsized":"2024-09-15T03:28:05.406189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:04:04.223376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407053+0000","last_change":"2024-09-15T03:27:28.535688+0000","last_active":"2024-09-15T03:28:05.407053+0000","last_peered":"2024-09-15T03:28:05.407053+0000","last_clean":"2024-09-15T03:28:05.407053+0000","last_became_active":"2024-09-15T03:27:28.535433+0000","last_became_peered":"2024-09-15T03:27:28.535433+0000","last_unstale":"2024-09-15T03:28:05.407053+0000","last_undegraded":"2024-09-15T03:28:05.407053+0000","last_fullsized":"2024-09-15T03:28:05.407053+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:46:00.867137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.984593+0000","last_change":"2024-09-15T03:27:30.550017+0000","last_active":"2024-09-15T03:28:05.984593+0000","last_peered":"2024-09-15T03:28:05.984593+0000","last_clean":"2024-09-15T03:28:05.984593+0000","last_became_active":"2024-09-15T03:27:30.549746+0000","last_became_peered":"2024-09-15T03:27:30.549746+0000","last_unstale":"2024-09-15T03:28:05.984593+0000","last_undegraded":"2024-09-15T03:28:05.984593+0000","last_fullsized":"2024-09-15T03:28:05.984593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T09:01:32.559554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"67'21","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.406073+0000","last_change":"2024-09-15T03:27:26.395561+0000","last_active":"2024-09-15T03:28:05.406073+0000","last_peered":"2024-09-15T03:28:05.406073+0000","last_clean":"2024-09-15T03:28:05.406073+0000","last_became_active":"2024-09-15T03:27:26.395038+0000","last_became_peered":"2024-09-15T03:27:26.395038+0000","last_unstale":"2024-09-15T03:28:05.406073+0000","last_undegraded":"2024-09-15T03:28:05.406073+0000","last_fullsized":"2024-09-15T03:28:05.406073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T11:19:44.971168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.400253+0000","last_change":"2024-09-15T03:27:24.381075+0000","last_active":"2024-09-15T03:28:05.400253+0000","last_peered":"2024-09-15T03:28:05.400253+0000","last_clean":"2024-09-15T03:28:05.400253+0000","last_became_active":"2024-09-15T03:27:24.380562+0000","last_became_peered":"2024-09-15T03:27:24.380562+0000","last_unstale":"2024-09-15T03:28:05.400253+0000","last_undegraded":"2024-09-15T03:28:05.400253+0000","last_fullsized":"2024-09-15T03:28:05.400253+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:09:30.894997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407151+0000","last_change":"2024-09-15T03:27:28.536165+0000","last_active":"2024-09-15T03:28:05.407151+0000","last_peered":"2024-09-15T03:28:05.407151+0000","last_clean":"2024-09-15T03:28:05.407151+0000","last_became_active":"2024-09-15T03:27:28.535913+0000","last_became_peered":"2024-09-15T03:27:28.535913+0000","last_unstale":"2024-09-15T03:28:05.407151+0000","last_undegraded":"2024-09-15T03:28:05.407151+0000","last_fullsized":"2024-09-15T03:28:05.407151+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:35:16.964691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408310+0000","last_change":"2024-09-15T03:27:31.124777+0000","last_active":"2024-09-15T03:28:05.408310+0000","last_peered":"2024-09-15T03:28:05.408310+0000","last_clean":"2024-09-15T03:28:05.408310+0000","last_became_active":"2024-09-15T03:27:31.124208+0000","last_became_peered":"2024-09-15T03:27:31.124208+0000","last_unstale":"2024-09-15T03:28:05.408310+0000","last_undegraded":"2024-09-15T03:28:05.408310+0000","last_fullsized":"2024-09-15T03:28:05.408310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T08:28:52.532727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.985294+0000","last_change":"2024-09-15T03:27:30.555019+0000","last_active":"2024-09-15T03:28:05.985294+0000","last_peered":"2024-09-15T03:28:05.985294+0000","last_clean":"2024-09-15T03:28:05.985294+0000","last_became_active":"2024-09-15T03:27:30.554701+0000","last_became_peered":"2024-09-15T03:27:30.554701+0000","last_unstale":"2024-09-15T03:28:05.985294+0000","last_undegraded":"2024-09-15T03:28:05.985294+0000","last_fullsized":"2024-09-15T03:28:05.985294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:46:26.912828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"67'39","reported_seq":106,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.401239+0000","last_change":"2024-09-15T03:27:26.399720+0000","last_active":"2024-09-15T03:28:05.401239+0000","last_peered":"2024-09-15T03:28:05.401239+0000","last_clean":"2024-09-15T03:28:05.401239+0000","last_became_active":"2024-09-15T03:27:26.399358+0000","last_became_peered":"2024-09-15T03:27:26.399358+0000","last_unstale":"2024-09-15T03:28:05.401239+0000","last_undegraded":"2024-09-15T03:28:05.401239+0000","last_fullsized":"2024-09-15T03:28:05.401239+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:15:01.840364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405133+0000","last_change":"2024-09-15T03:27:24.384148+0000","last_active":"2024-09-15T03:28:05.405133+0000","last_peered":"2024-09-15T03:28:05.405133+0000","last_clean":"2024-09-15T03:28:05.405133+0000","last_became_active":"2024-09-15T03:27:24.383789+0000","last_became_peered":"2024-09-15T03:27:24.383789+0000","last_unstale":"2024-09-15T03:28:05.405133+0000","last_undegraded":"2024-09-15T03:28:05.405133+0000","last_fullsized":"2024-09-15T03:28:05.405133+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:48:24.252555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.987799+0000","last_change":"2024-09-15T03:27:28.530455+0000","last_active":"2024-09-15T03:28:05.987799+0000","last_peered":"2024-09-15T03:28:05.987799+0000","last_clean":"2024-09-15T03:28:05.987799+0000","last_became_active":"2024-09-15T03:27:28.530170+0000","last_became_peered":"2024-09-15T03:27:28.530170+0000","last_unstale":"2024-09-15T03:28:05.987799+0000","last_undegraded":"2024-09-15T03:28:05.987799+0000","last_fullsized":"2024-09-15T03:28:05.987799+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:04:04.159954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.403746+0000","last_change":"2024-09-15T03:27:30.555093+0000","last_active":"2024-09-15T03:28:05.403746+0000","last_peered":"2024-09-15T03:28:05.403746+0000","last_clean":"2024-09-15T03:28:05.403746+0000","last_became_active":"2024-09-15T03:27:30.554827+0000","last_became_peered":"2024-09-15T03:27:30.554827+0000","last_unstale":"2024-09-15T03:28:05.403746+0000","last_undegraded":"2024-09-15T03:28:05.403746+0000","last_fullsized":"2024-09-15T03:28:05.403746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T13:19:34.507008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"67'15","reported_seq":52,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407515+0000","last_change":"2024-09-15T03:27:26.401711+0000","last_active":"2024-09-15T03:28:05.407515+0000","last_peered":"2024-09-15T03:28:05.407515+0000","last_clean":"2024-09-15T03:28:05.407515+0000","last_became_active":"2024-09-15T03:27:26.401394+0000","last_became_peered":"2024-09-15T03:27:26.401394+0000","last_unstale":"2024-09-15T03:28:05.407515+0000","last_undegraded":"2024-09-15T03:28:05.407515+0000","last_fullsized":"2024-09-15T03:28:05.407515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:39:59.009034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":22,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408134+0000","last_change":"2024-09-15T03:27:24.378542+0000","last_active":"2024-09-15T03:28:05.408134+0000","last_peered":"2024-09-15T03:28:05.408134+0000","last_clean":"2024-09-15T03:28:05.408134+0000","last_became_active":"2024-09-15T03:27:24.378021+0000","last_became_peered":"2024-09-15T03:27:24.378021+0000","last_unstale":"2024-09-15T03:28:05.408134+0000","last_undegraded":"2024-09-15T03:28:05.408134+0000","last_fullsized":"2024-09-15T03:28:05.408134+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T15:09:01.141007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"73'12","reported_seq":89,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-15T03:30:39.499447+0000","last_change":"2024-09-15T03:28:05.408604+0000","last_active":"2024-09-15T03:30:39.499447+0000","last_peered":"2024-09-15T03:30:39.499447+0000","last_clean":"2024-09-15T03:30:39.499447+0000","last_became_active":"2024-09-15T03:28:05.405547+0000","last_became_peered":"2024-09-15T03:28:05.405547+0000","last_unstale":"2024-09-15T03:30:39.499447+0000","last_undegraded":"2024-09-15T03:30:39.499447+0000","last_fullsized":"2024-09-15T03:30:39.499447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:38:51.932395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402689+0000","last_change":"2024-09-15T03:27:31.121221+0000","last_active":"2024-09-15T03:28:05.402689+0000","last_peered":"2024-09-15T03:28:05.402689+0000","last_clean":"2024-09-15T03:28:05.402689+0000","last_became_active":"2024-09-15T03:27:31.120354+0000","last_became_peered":"2024-09-15T03:27:31.120354+0000","last_unstale":"2024-09-15T03:28:05.402689+0000","last_undegraded":"2024-09-15T03:28:05.402689+0000","last_fullsized":"2024-09-15T03:28:05.402689+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T07:35:22.253196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.399301+0000","last_change":"2024-09-15T03:27:24.385888+0000","last_active":"2024-09-15T03:28:05.399301+0000","last_peered":"2024-09-15T03:28:05.399301+0000","last_clean":"2024-09-15T03:28:05.399301+0000","last_became_active":"2024-09-15T03:27:24.385563+0000","last_became_peered":"2024-09-15T03:27:24.385563+0000","last_unstale":"2024-09-15T03:28:05.399301+0000","last_undegraded":"2024-09-15T03:28:05.399301+0000","last_fullsized":"2024-09-15T03:28:05.399301+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:55:18.192592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'11","reported_seq":46,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.988029+0000","last_change":"2024-09-15T03:27:26.394035+0000","last_active":"2024-09-15T03:28:05.988029+0000","last_peered":"2024-09-15T03:28:05.988029+0000","last_clean":"2024-09-15T03:28:05.988029+0000","last_became_active":"2024-09-15T03:27:26.393117+0000","last_became_peered":"2024-09-15T03:27:26.393117+0000","last_unstale":"2024-09-15T03:28:05.988029+0000","last_undegraded":"2024-09-15T03:28:05.988029+0000","last_fullsized":"2024-09-15T03:28:05.988029+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T03:46:36.750732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.405673+0000","last_change":"2024-09-15T03:27:28.526869+0000","last_active":"2024-09-15T03:28:05.405673+0000","last_peered":"2024-09-15T03:28:05.405673+0000","last_clean":"2024-09-15T03:28:05.405673+0000","last_became_active":"2024-09-15T03:27:28.526477+0000","last_became_peered":"2024-09-15T03:27:28.526477+0000","last_unstale":"2024-09-15T03:28:05.405673+0000","last_undegraded":"2024-09-15T03:28:05.405673+0000","last_fullsized":"2024-09-15T03:28:05.405673+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T06:39:18.512369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408066+0000","last_change":"2024-09-15T03:27:31.122974+0000","last_active":"2024-09-15T03:28:05.408066+0000","last_peered":"2024-09-15T03:28:05.408066+0000","last_clean":"2024-09-15T03:28:05.408066+0000","last_became_active":"2024-09-15T03:27:31.122432+0000","last_became_peered":"2024-09-15T03:27:31.122432+0000","last_unstale":"2024-09-15T03:28:05.408066+0000","last_undegraded":"2024-09-15T03:28:05.408066+0000","last_fullsized":"2024-09-15T03:28:05.408066+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:29.523881+0000","last_clean_scrub_stamp":"2024-09-15T03:27:29.523881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:44:21.490206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.408441+0000","last_change":"2024-09-15T03:27:24.388762+0000","last_active":"2024-09-15T03:28:05.408441+0000","last_peered":"2024-09-15T03:28:05.408441+0000","last_clean":"2024-09-15T03:28:05.408441+0000","last_became_active":"2024-09-15T03:27:24.388368+0000","last_became_peered":"2024-09-15T03:27:24.388368+0000","last_unstale":"2024-09-15T03:28:05.408441+0000","last_undegraded":"2024-09-15T03:28:05.408441+0000","last_fullsized":"2024-09-15T03:28:05.408441+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:23.350861+0000","last_clean_scrub_stamp":"2024-09-15T03:27:23.350861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T14:35:15.391745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'21","reported_seq":67,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.402371+0000","last_change":"2024-09-15T03:27:26.652414+0000","last_active":"2024-09-15T03:28:05.402371+0000","last_peered":"2024-09-15T03:28:05.402371+0000","last_clean":"2024-09-15T03:28:05.402371+0000","last_became_active":"2024-09-15T03:27:26.651962+0000","last_became_peered":"2024-09-15T03:27:26.651962+0000","last_unstale":"2024-09-15T03:28:05.402371+0000","last_undegraded":"2024-09-15T03:28:05.402371+0000","last_fullsized":"2024-09-15T03:28:05.402371+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:25.365626+0000","last_clean_scrub_stamp":"2024-09-15T03:27:25.365626+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T05:43:06.095685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-09-15T03:28:05.407997+0000","last_change":"2024-09-15T03:27:28.533333+0000","last_active":"2024-09-15T03:28:05.407997+0000","last_peered":"2024-09-15T03:28:05.407997+0000","last_clean":"2024-09-15T03:28:05.407997+0000","last_became_active":"2024-09-15T03:27:28.532762+0000","last_became_peered":"2024-09-15T03:27:28.532762+0000","last_unstale":"2024-09-15T03:28:05.407997+0000","last_undegraded":"2024-09-15T03:28:05.407997+0000","last_fullsized":"2024-09-15T03:28:05.407997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T03:27:27.386126+0000","last_clean_scrub_stamp":"2024-09-15T03:27:27.386126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T12:53:03.735966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":176,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":9,"acting":9,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":1085,"num_read_kb":810,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":586,"ondisk_log_size":586,"up":96,"acting":96,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1328,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":258,"num_write":179,"num_write_kb":3194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234036,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298764,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442292,"statfs":{"total":95990841344,"available":95684907008,"internally_reserved":0,"allocated":1441792,"data_stored":942637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.85499999999999998,"15min":0.89000000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.90200000000000002,"15min":0.95199999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.056,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.873,"15min":0.90900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.147,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.85299999999999998,"15min":0.89200000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.016,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.91000000000000003,"15min":0.95799999999999996},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.88500000000000001,"15min":0.90800000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":1.083}]},{"osd":3,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.90800000000000003,"15min":0.95499999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.2090000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.95099999999999996,"15min":0.997},"min":{"1min":0.60699999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3029999999999999,"5min":1.333,"15min":1.333},"last":0.81399999999999995}]},{"osd":4,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.753,"15min":0.78500000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96399999999999997,"5min":1.119,"15min":1.119},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.84699999999999998,"15min":0.89300000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.206}]},{"osd":5,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.87,"15min":0.89900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.879,"15min":0.93300000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.123,"5min":1.246,"15min":1.246},"last":1.1160000000000001}]},{"osd":6,"last update":"Sun Sep 15 03:29:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.90100000000000002,"15min":0.94699999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.98499999999999999,"15min":1.0409999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5469999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.1559999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298728,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442328,"statfs":{"total":95990841344,"available":95684943872,"internally_reserved":0,"allocated":1409024,"data_stored":941834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81299999999999994,"15min":0.82899999999999996},"min":{"1min":0.53300000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.0409999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":1.018},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.80200000000000005,"15min":0.83499999999999996},"min":{"1min":0.52600000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1739999999999999}]},{"osd":1,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.83699999999999997,"15min":0.86899999999999999},"min":{"1min":0.58399999999999996,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.61499999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.252,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.069}]},{"osd":2,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79100000000000004,"15min":0.80900000000000005},"min":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.141,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.1359999999999999}]},{"osd":3,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.89700000000000002,"15min":0.91500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1439999999999999,"5min":1.345,"15min":1.345},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.84999999999999998,"15min":0.88400000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.093}]},{"osd":4,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.443,"5min":0.377,"15min":0.377},"max":{"1min":1.0840000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.04},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.224,"5min":1.373,"15min":1.373},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Sep 15 03:30:00 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.81499999999999995,"15min":0.80900000000000005},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.84099999999999997,"15min":0.82799999999999996},"min":{"1min":0.44600000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2470000000000001,"5min":1.389,"15min":1.389},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Sep 15 03:29:46 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.93799999999999994,"15min":0.97799999999999998},"min":{"1min":0.46500000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.96999999999999997,"15min":1.0049999999999999},"min":{"1min":0.503,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.2969999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.877}]}]},{"osd":5,"up_from":38,"seq":163208757323,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298156,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442900,"statfs":{"total":95990841344,"available":95685529600,"internally_reserved":0,"allocated":819200,"data_stored":351894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81599999999999995,"15min":0.78100000000000003},"min":{"1min":0.50700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.1359999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.83999999999999997,"15min":0.83799999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2050000000000001,"5min":1.264,"15min":1.264},"last":0.997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79400000000000004,"15min":0.83399999999999996},"min":{"1min":0.45200000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98599999999999999,"5min":1.159,"15min":1.159},"last":0.873}]},{"osd":2,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.55600000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.073,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85099999999999998,"15min":0.85599999999999998},"min":{"1min":0.56299999999999994,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.84899999999999998,"15min":0.86499999999999999},"min":{"1min":0.58999999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.103,"5min":1.387,"15min":1.387},"last":1.081},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.86699999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0860000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0620000000000001}]},{"osd":4,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68600000000000005,"15min":0.70799999999999996},"min":{"1min":0.376,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.01,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71599999999999997,"15min":0.70099999999999996},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.161,"5min":1.3,"15min":1.3},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.48299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.125,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.149},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78200000000000003,"15min":0.81999999999999995},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":1.0980000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.93999999999999995}]},{"osd":7,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83999999999999997,"15min":0.86599999999999999},"min":{"1min":0.52500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0409999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.036},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92800000000000005,"15min":0.95399999999999996},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":1.1879999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018967,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298192,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442864,"statfs":{"total":95990841344,"available":95685492736,"internally_reserved":0,"allocated":856064,"data_stored":352606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.81999999999999995,"15min":0.82799999999999996},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.83699999999999997,"15min":0.84399999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96999999999999997,"5min":1.613,"15min":1.613},"last":1.0680000000000001}]},{"osd":1,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83899999999999997,"15min":0.82499999999999996},"min":{"1min":0.60099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3939999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81799999999999995,"15min":0.82699999999999996},"min":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.046}]},{"osd":2,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.872,"15min":0.82799999999999996},"min":{"1min":0.55700000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.232,"5min":1.349,"15min":1.349},"last":0.753}]},{"osd":3,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85699999999999998,"15min":0.88900000000000001},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1899999999999999,"5min":1.274,"15min":1.47},"last":0.877},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.51200000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.155,"5min":1.2010000000000001,"15min":1.2549999999999999},"last":1}]},{"osd":5,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.753,"15min":0.70699999999999996},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.7130000000000001,"5min":2.0339999999999998,"15min":2.0339999999999998},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.70899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0940000000000001,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.45400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":1.105},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":0.98799999999999999},"min":{"1min":0.47299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.1850000000000001,"5min":2.895,"15min":2.895},"last":1.026}]},{"osd":7,"last update":"Sun Sep 15 03:29:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.88,"15min":0.89800000000000002},"min":{"1min":0.51500000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.92900000000000005,"15min":0.93700000000000006},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.798,"5min":2.798,"15min":2.798},"last":1.1499999999999999}]}]},{"osd":3,"up_from":25,"seq":107374182499,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298152,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442904,"statfs":{"total":95990841344,"available":95685533696,"internally_reserved":0,"allocated":815104,"data_stored":351329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.69399999999999995,"15min":0.67800000000000005},"min":{"1min":0.35899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.92900000000000005,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72399999999999998,"15min":0.70399999999999996},"min":{"1min":0.373,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.83399999999999996}]},{"osd":1,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77900000000000003,"15min":0.73699999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.079,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.72599999999999998}]},{"osd":2,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.79800000000000004,"15min":0.77300000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35699999999999998},"max":{"1min":0.98799999999999999,"5min":1.276,"15min":1.276},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.75700000000000001,"15min":0.75900000000000001},"min":{"1min":0.41099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.153,"5min":1.228,"15min":1.228},"last":0.68600000000000005}]},{"osd":4,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.92000000000000004,"15min":0.90000000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.2809999999999999,"5min":1.2889999999999999,"15min":1.407},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.0169999999999999,"15min":0.93899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.78700000000000003}]},{"osd":5,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0329999999999999,"15min":1.032},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3560000000000001,"5min":1.581,"15min":1.581},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93100000000000005,"15min":0.93300000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.0780000000000001,"15min":1.1040000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.444,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.97699999999999998,"15min":0.97499999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.999}]},{"osd":7,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.0229999999999999,"15min":1.0389999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.048,"15min":1.0569999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":1.2070000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298156,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442900,"statfs":{"total":95990841344,"available":95685529600,"internally_reserved":0,"allocated":819200,"data_stored":351647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:29:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.67200000000000004,"15min":0.623},"min":{"1min":0.47099999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.1200000000000001,"5min":1.165,"15min":1.165},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67600000000000005,"15min":0.63800000000000001},"min":{"1min":0.311,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.97399999999999998,"5min":1.026,"15min":1.946},"last":0.79200000000000004}]},{"osd":1,"last update":"Sun Sep 15 03:29:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.67500000000000004},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.69999999999999996,"15min":0.64100000000000001},"min":{"1min":0.38600000000000001,"5min":0.315,"15min":0.27800000000000002},"max":{"1min":1.0580000000000001,"5min":1.379,"15min":1.379},"last":0.84599999999999997}]},{"osd":3,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81499999999999995,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.76900000000000002,"15min":0.73399999999999999},"min":{"1min":0.436,"5min":0.316,"15min":0.316},"max":{"1min":1.0820000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.95599999999999996}]},{"osd":4,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.91800000000000004,"15min":0.89600000000000002},"min":{"1min":0.53200000000000003,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.169,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.036},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.008,"15min":0.97199999999999998},"min":{"1min":0.64100000000000001,"5min":0.497,"15min":0.497},"max":{"1min":1.4370000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.0149999999999999}]},{"osd":5,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.997,"15min":0.95699999999999996},"min":{"1min":0.63100000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.91900000000000004,"15min":0.94699999999999995},"min":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2330000000000001,"5min":1.254,"15min":1.254},"last":1.079}]},{"osd":6,"last update":"Sun Sep 15 03:29:53 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.87,"15min":0.85999999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1000000000000001,"5min":1.244,"15min":1.244},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.079,"15min":1.087},"min":{"1min":0.65000000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Sun Sep 15 03:30:45 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.96999999999999997,"15min":1.004},"min":{"1min":0.57299999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4039999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.002},{"interface":"front","average":{"1min":1.016,"5min":1.1040000000000001,"15min":1.133},"min":{"1min":0.68799999999999994,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.331,"5min":1.55,"15min":1.55},"last":1.0940000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574970,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298164,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442892,"statfs":{"total":95990841344,"available":95685521408,"internally_reserved":0,"allocated":827392,"data_stored":351630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Sep 15 03:30:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.67700000000000005,"15min":0.59099999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.76200000000000001,"15min":0.629},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.318},"max":{"1min":1.008,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.47699999999999998}]},{"osd":2,"last update":"Sun Sep 15 03:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.63200000000000001},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.6799999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.82699999999999996,"15min":0.68200000000000005},"min":{"1min":0.436,"5min":0.434,"15min":0.35899999999999999},"max":{"1min":1.466,"5min":1.546,"15min":1.546},"last":0.53000000000000003}]},{"osd":3,"last update":"Sun Sep 15 03:29:57 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.85899999999999999,"15min":0.79100000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2070000000000001,"5min":1.321,"15min":1.321},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.745},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6180000000000001,"5min":2.831,"15min":2.831},"last":0.42499999999999999}]},{"osd":4,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.96599999999999997,"15min":0.88500000000000001},"min":{"1min":0.76000000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.2330000000000001,"5min":1.885,"15min":1.885},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.014,"15min":0.92600000000000005},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.431,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.89900000000000002},"min":{"1min":0.71399999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.181,"5min":1.9750000000000001,"15min":1.9750000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.1100000000000001,"15min":1.0209999999999999},"min":{"1min":0.74399999999999999,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4450000000000001,"5min":8.782,"15min":8.782},"last":0.95699999999999996}]},{"osd":6,"last update":"Sun Sep 15 03:29:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.091,"15min":1.0409999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.4289999999999998,"5min":4.9409999999999998,"15min":4.9409999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0469999999999999,"15min":1.0109999999999999},"min":{"1min":0.83899999999999997,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.2270000000000001,"5min":4.899,"15min":4.899},"last":0.98599999999999999}]},{"osd":7,"last update":"Sun Sep 15 03:29:49 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1359999999999999,"15min":1.1519999999999999},"min":{"1min":0.76900000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.3100000000000001,"5min":2.4409999999999998,"15min":2.4409999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1890000000000001},"min":{"1min":0.755,"5min":0.748,"15min":0.748},"max":{"1min":1.536,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.97499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738500,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":298744,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93442312,"statfs":{"total":95990841344,"available":95684927488,"internally_reserved":0,"allocated":1425408,"data_stored":941944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Sep 15 03:30:07 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.70399999999999996,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.29199999999999998},"max":{"1min":1.052,"5min":2.544,"15min":2.544},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70799999999999996,"15min":0.61099999999999999},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Sep 15 03:30:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.746,"15min":0.66800000000000004},"min":{"1min":0.41099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.24,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73999999999999999,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.228,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Sun Sep 15 03:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71799999999999997,"15min":0.70499999999999996},"min":{"1min":0.45500000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93999999999999995,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.503},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81499999999999995,"15min":0.76400000000000001},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.135,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.90400000000000003}]},{"osd":4,"last update":"Sun Sep 15 03:29:58 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.96799999999999997,"15min":0.94299999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.27,"5min":1.3049999999999999,"15min":1.3109999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.92500000000000004,"15min":0.91600000000000004},"min":{"1min":0.66700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.121,"5min":1.323,"15min":1.323},"last":0.751}]},{"osd":5,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.96399999999999997,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.375,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.90600000000000003,"15min":0.92300000000000004},"min":{"1min":0.67800000000000005,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.3979999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.0089999999999999}]},{"osd":6,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0369999999999999,"15min":1.0549999999999999},"min":{"1min":0.60399999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.083},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.96299999999999997,"15min":0.95199999999999996},"min":{"1min":0.73999999999999999,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2070000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.92200000000000004}]},{"osd":7,"last update":"Sun Sep 15 03:29:48 2024","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.036,"15min":1.036},"min":{"1min":0.71099999999999997,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.034,"15min":1.054},"min":{"1min":0.71599999999999997,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.137,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":0.86799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T03:30:51.644 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T03:30:51.644 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T03:30:51.645 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T03:30:51.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell --fsid aed93852-7310-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T03:30:52.388 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:52 smithi053 bash[21662]: audit 2024-09-15T03:30:50.996562+0000 mgr.y (mgr.24494) 124 : audit [DBG] from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:30:52.389 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:52 smithi053 bash[21662]: cluster 2024-09-15T03:30:51.054609+0000 mgr.y (mgr.24494) 125 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:52.389 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:52 smithi053 bash[15077]: audit 2024-09-15T03:30:50.996562+0000 mgr.y (mgr.24494) 124 : audit [DBG] from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:30:52.389 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:52 smithi053 bash[15077]: cluster 2024-09-15T03:30:51.054609+0000 mgr.y (mgr.24494) 125 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:52.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:52 smithi104 bash[15781]: audit 2024-09-15T03:30:50.996562+0000 mgr.y (mgr.24494) 124 : audit [DBG] from='client.14739 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T03:30:52.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:52 smithi104 bash[15781]: cluster 2024-09-15T03:30:51.054609+0000 mgr.y (mgr.24494) 125 : cluster [DBG] pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:53.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:30:52 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:52] "GET /metrics HTTP/1.1" 200 219603 "" "Prometheus/2.43.0" 2024-09-15T03:30:54.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:54 smithi053 bash[21662]: cluster 2024-09-15T03:30:53.055965+0000 mgr.y (mgr.24494) 126 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:54.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:54 smithi053 bash[15077]: cluster 2024-09-15T03:30:53.055965+0000 mgr.y (mgr.24494) 126 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:54.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:54 smithi104 bash[15781]: cluster 2024-09-15T03:30:53.055965+0000 mgr.y (mgr.24494) 126 : cluster [DBG] pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:30:54.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:30:54 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:30:54] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:30:56.437 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:30:56.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:56 smithi053 bash[15077]: cluster 2024-09-15T03:30:55.056681+0000 mgr.y (mgr.24494) 127 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:56.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:56 smithi053 bash[21662]: cluster 2024-09-15T03:30:55.056681+0000 mgr.y (mgr.24494) 127 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:56.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:56 smithi104 bash[15781]: cluster 2024-09-15T03:30:55.056681+0000 mgr.y (mgr.24494) 127 : cluster [DBG] pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:57.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:57 smithi053 bash[15077]: audit 2024-09-15T03:30:57.090526+0000 mon.a (mon.0) 1233 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:57.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:57 smithi053 bash[21662]: audit 2024-09-15T03:30:57.090526+0000 mon.a (mon.0) 1233 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:57.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:57 smithi104 bash[15781]: audit 2024-09-15T03:30:57.090526+0000 mon.a (mon.0) 1233 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:30:58.387 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:58 smithi053 bash[21662]: cluster 2024-09-15T03:30:57.057264+0000 mgr.y (mgr.24494) 128 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:58.387 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:58 smithi053 bash[15077]: cluster 2024-09-15T03:30:57.057264+0000 mgr.y (mgr.24494) 128 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:58.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:30:58 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:30:58.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:58 smithi104 bash[15781]: cluster 2024-09-15T03:30:57.057264+0000 mgr.y (mgr.24494) 128 : cluster [DBG] pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:30:59.401 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:30:59 smithi053 bash[15077]: audit 2024-09-15T03:30:58.138628+0000 mgr.y (mgr.24494) 129 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:59.401 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:30:59 smithi053 bash[21662]: audit 2024-09-15T03:30:58.138628+0000 mgr.y (mgr.24494) 129 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:59.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:30:59 smithi104 bash[15781]: audit 2024-09-15T03:30:58.138628+0000 mgr.y (mgr.24494) 129 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:30:59.772 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-09-15T03:30:59.772 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T03:31:00.426 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:00 smithi053 bash[21662]: cluster 2024-09-15T03:30:59.058388+0000 mgr.y (mgr.24494) 130 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:00.427 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:00 smithi053 bash[21662]: audit 2024-09-15T03:30:59.770398+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.53:0/4071330810' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T03:31:00.427 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:00 smithi053 bash[15077]: cluster 2024-09-15T03:30:59.058388+0000 mgr.y (mgr.24494) 130 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:00.427 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:00 smithi053 bash[15077]: audit 2024-09-15T03:30:59.770398+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.53:0/4071330810' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T03:31:00.428 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T03:31:00.428 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T03:31:00.428 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T03:31:00.438 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi053.front.sepia.ceph.com 2024-09-15T03:31:00.438 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'stat -c '"'"'%u %g'"'"' /var/log/ceph | grep '"'"'167 167'"'"'' 2024-09-15T03:31:00.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:00 smithi104 bash[15781]: cluster 2024-09-15T03:30:59.058388+0000 mgr.y (mgr.24494) 130 : cluster [DBG] pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:00.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:00 smithi104 bash[15781]: audit 2024-09-15T03:30:59.770398+0000 mon.c (mon.2) 21 : audit [DBG] from='client.? 172.21.15.53:0/4071330810' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T03:31:02.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:02 smithi053 bash[21662]: cluster 2024-09-15T03:31:01.059074+0000 mgr.y (mgr.24494) 131 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:02.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:02 smithi053 bash[15077]: cluster 2024-09-15T03:31:01.059074+0000 mgr.y (mgr.24494) 131 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:02.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:02 smithi104 bash[15781]: cluster 2024-09-15T03:31:01.059074+0000 mgr.y (mgr.24494) 131 : cluster [DBG] pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:03.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:31:02 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:02] "GET /metrics HTTP/1.1" 200 219612 "" "Prometheus/2.43.0" 2024-09-15T03:31:04.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:04 smithi053 bash[15077]: cluster 2024-09-15T03:31:03.060368+0000 mgr.y (mgr.24494) 132 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:04.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:04 smithi053 bash[21662]: cluster 2024-09-15T03:31:03.060368+0000 mgr.y (mgr.24494) 132 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:04.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:04 smithi104 bash[15781]: cluster 2024-09-15T03:31:03.060368+0000 mgr.y (mgr.24494) 132 : cluster [DBG] pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:04.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:31:04 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:31:05.226 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:31:06.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:06 smithi053 bash[21662]: cluster 2024-09-15T03:31:05.061105+0000 mgr.y (mgr.24494) 133 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:06.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:06 smithi053 bash[15077]: cluster 2024-09-15T03:31:05.061105+0000 mgr.y (mgr.24494) 133 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:06.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:06 smithi104 bash[15781]: cluster 2024-09-15T03:31:05.061105+0000 mgr.y (mgr.24494) 133 : cluster [DBG] pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[21662]: audit 2024-09-15T03:31:06.949340+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[21662]: audit 2024-09-15T03:31:06.956227+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[21662]: audit 2024-09-15T03:31:06.962449+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[21662]: cluster 2024-09-15T03:31:07.061836+0000 mgr.y (mgr.24494) 134 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[15077]: audit 2024-09-15T03:31:06.949340+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[15077]: audit 2024-09-15T03:31:06.956227+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[15077]: audit 2024-09-15T03:31:06.962449+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.154 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:07 smithi053 bash[15077]: cluster 2024-09-15T03:31:07.061836+0000 mgr.y (mgr.24494) 134 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:08.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:31:08 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:31:08.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:07 smithi104 bash[15781]: audit 2024-09-15T03:31:06.949340+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:07 smithi104 bash[15781]: audit 2024-09-15T03:31:06.956227+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:07 smithi104 bash[15781]: audit 2024-09-15T03:31:06.962449+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:08.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:07 smithi104 bash[15781]: cluster 2024-09-15T03:31:07.061836+0000 mgr.y (mgr.24494) 134 : cluster [DBG] pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:09.445 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[15077]: audit 2024-09-15T03:31:08.147260+0000 mgr.y (mgr.24494) 135 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:09.445 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[15077]: audit 2024-09-15T03:31:08.311797+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.445 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[15077]: audit 2024-09-15T03:31:08.318601+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.446 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[15077]: audit 2024-09-15T03:31:08.326154+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.446 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[21662]: audit 2024-09-15T03:31:08.147260+0000 mgr.y (mgr.24494) 135 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:09.446 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[21662]: audit 2024-09-15T03:31:08.311797+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.446 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[21662]: audit 2024-09-15T03:31:08.318601+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.446 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:09 smithi053 bash[21662]: audit 2024-09-15T03:31:08.326154+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:09 smithi104 bash[15781]: audit 2024-09-15T03:31:08.147260+0000 mgr.y (mgr.24494) 135 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:09.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:09 smithi104 bash[15781]: audit 2024-09-15T03:31:08.311797+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:09 smithi104 bash[15781]: audit 2024-09-15T03:31:08.318601+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:09.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:09 smithi104 bash[15781]: audit 2024-09-15T03:31:08.326154+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:10.001 INFO:teuthology.orchestra.run.smithi053.stdout:167 167 2024-09-15T03:31:10.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:10 smithi053 bash[15077]: cluster 2024-09-15T03:31:09.063290+0000 mgr.y (mgr.24494) 136 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:10.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:10 smithi053 bash[21662]: cluster 2024-09-15T03:31:09.063290+0000 mgr.y (mgr.24494) 136 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:10.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:10 smithi104 bash[15781]: cluster 2024-09-15T03:31:09.063290+0000 mgr.y (mgr.24494) 136 : cluster [DBG] pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:10.995 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T03:31:12.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:12 smithi053 bash[21662]: cluster 2024-09-15T03:31:11.063789+0000 mgr.y (mgr.24494) 137 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:12.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:12 smithi053 bash[21662]: audit 2024-09-15T03:31:12.090926+0000 mon.a (mon.0) 1240 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:12.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:12 smithi053 bash[15077]: cluster 2024-09-15T03:31:11.063789+0000 mgr.y (mgr.24494) 137 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:12.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:12 smithi053 bash[15077]: audit 2024-09-15T03:31:12.090926+0000 mon.a (mon.0) 1240 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:12.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:12 smithi104 bash[15781]: cluster 2024-09-15T03:31:11.063789+0000 mgr.y (mgr.24494) 137 : cluster [DBG] pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:12.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:12 smithi104 bash[15781]: audit 2024-09-15T03:31:12.090926+0000 mon.a (mon.0) 1240 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:13.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:31:12 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:12] "GET /metrics HTTP/1.1" 200 219614 "" "Prometheus/2.43.0" 2024-09-15T03:31:14.336 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:31:14 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:31:14.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:14 smithi053 bash[21662]: cluster 2024-09-15T03:31:13.065181+0000 mgr.y (mgr.24494) 138 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:14.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:14 smithi053 bash[15077]: cluster 2024-09-15T03:31:13.065181+0000 mgr.y (mgr.24494) 138 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:14.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:14 smithi104 bash[15781]: cluster 2024-09-15T03:31:13.065181+0000 mgr.y (mgr.24494) 138 : cluster [DBG] pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:16.062 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:31:16.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:16 smithi053 bash[21662]: cluster 2024-09-15T03:31:15.065859+0000 mgr.y (mgr.24494) 139 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:16.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:16 smithi053 bash[15077]: cluster 2024-09-15T03:31:15.065859+0000 mgr.y (mgr.24494) 139 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:16.671 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:16 smithi104 bash[15781]: cluster 2024-09-15T03:31:15.065859+0000 mgr.y (mgr.24494) 139 : cluster [DBG] pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:18.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:18 smithi104 bash[15781]: cluster 2024-09-15T03:31:17.066631+0000 mgr.y (mgr.24494) 140 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:18.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:31:18 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:31:18.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:18 smithi053 bash[15077]: cluster 2024-09-15T03:31:17.066631+0000 mgr.y (mgr.24494) 140 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:18.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:18 smithi053 bash[21662]: cluster 2024-09-15T03:31:17.066631+0000 mgr.y (mgr.24494) 140 : cluster [DBG] pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:19.361 INFO:teuthology.orchestra.run.smithi053.stdout:Backend: cephadm 2024-09-15T03:31:19.361 INFO:teuthology.orchestra.run.smithi053.stdout:Available: Yes 2024-09-15T03:31:19.361 INFO:teuthology.orchestra.run.smithi053.stdout:Paused: No 2024-09-15T03:31:19.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:19 smithi104 bash[15781]: audit 2024-09-15T03:31:18.155474+0000 mgr.y (mgr.24494) 141 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:19.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:19 smithi053 bash[15077]: audit 2024-09-15T03:31:18.155474+0000 mgr.y (mgr.24494) 141 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:19.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:19 smithi053 bash[21662]: audit 2024-09-15T03:31:18.155474+0000 mgr.y (mgr.24494) 141 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:20.073 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T03:31:20.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:20 smithi053 bash[21662]: cluster 2024-09-15T03:31:19.068025+0000 mgr.y (mgr.24494) 142 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:20.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:20 smithi053 bash[15077]: cluster 2024-09-15T03:31:19.068025+0000 mgr.y (mgr.24494) 142 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:20.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:20 smithi104 bash[15781]: cluster 2024-09-15T03:31:19.068025+0000 mgr.y (mgr.24494) 142 : cluster [DBG] pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:21.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:21 smithi053 bash[21662]: audit 2024-09-15T03:31:19.359026+0000 mgr.y (mgr.24494) 143 : audit [DBG] from='client.24680 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:21.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:21 smithi053 bash[15077]: audit 2024-09-15T03:31:19.359026+0000 mgr.y (mgr.24494) 143 : audit [DBG] from='client.24680 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:21.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:21 smithi104 bash[15781]: audit 2024-09-15T03:31:19.359026+0000 mgr.y (mgr.24494) 143 : audit [DBG] from='client.24680 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:22.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:22 smithi053 bash[21662]: cluster 2024-09-15T03:31:21.068750+0000 mgr.y (mgr.24494) 144 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:22.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:22 smithi053 bash[15077]: cluster 2024-09-15T03:31:21.068750+0000 mgr.y (mgr.24494) 144 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:22.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:22 smithi104 bash[15781]: cluster 2024-09-15T03:31:21.068750+0000 mgr.y (mgr.24494) 144 : cluster [DBG] pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:23.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:31:22 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:22] "GET /metrics HTTP/1.1" 200 219614 "" "Prometheus/2.43.0" 2024-09-15T03:31:23.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:23 smithi053 bash[15077]: cluster 2024-09-15T03:31:23.070136+0000 mgr.y (mgr.24494) 145 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:23.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:23 smithi053 bash[21662]: cluster 2024-09-15T03:31:23.070136+0000 mgr.y (mgr.24494) 145 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:23.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:23 smithi104 bash[15781]: cluster 2024-09-15T03:31:23.070136+0000 mgr.y (mgr.24494) 145 : cluster [DBG] pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:24.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:31:24 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:31:24.864 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:31:26.385 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:26 smithi053 bash[21662]: cluster 2024-09-15T03:31:25.070874+0000 mgr.y (mgr.24494) 146 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:26.385 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:26 smithi053 bash[15077]: cluster 2024-09-15T03:31:25.070874+0000 mgr.y (mgr.24494) 146 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:26.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:26 smithi104 bash[15781]: cluster 2024-09-15T03:31:25.070874+0000 mgr.y (mgr.24494) 146 : cluster [DBG] pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:27.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:27 smithi053 bash[21662]: audit 2024-09-15T03:31:27.091078+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:27.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:27 smithi053 bash[21662]: audit 2024-09-15T03:31:27.124761+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:27.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:27 smithi053 bash[15077]: audit 2024-09-15T03:31:27.091078+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:27.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:27 smithi053 bash[15077]: audit 2024-09-15T03:31:27.124761+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:27.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:27 smithi104 bash[15781]: audit 2024-09-15T03:31:27.091078+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:27.488 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:27 smithi104 bash[15781]: audit 2024-09-15T03:31:27.124761+0000 mon.a (mon.0) 1242 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:28.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:28 smithi053 bash[15077]: cluster 2024-09-15T03:31:27.071433+0000 mgr.y (mgr.24494) 147 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:28.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:28 smithi053 bash[15077]: audit 2024-09-15T03:31:27.130654+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:28.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:28 smithi053 bash[15077]: audit 2024-09-15T03:31:27.140357+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:28 smithi053 bash[21662]: cluster 2024-09-15T03:31:27.071433+0000 mgr.y (mgr.24494) 147 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:28 smithi053 bash[21662]: audit 2024-09-15T03:31:27.130654+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:28.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:28 smithi053 bash[21662]: audit 2024-09-15T03:31:27.140357+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:28.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:31:28 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:31:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:28 smithi104 bash[15781]: cluster 2024-09-15T03:31:27.071433+0000 mgr.y (mgr.24494) 147 : cluster [DBG] pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:28 smithi104 bash[15781]: audit 2024-09-15T03:31:27.130654+0000 mon.a (mon.0) 1243 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:28.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:28 smithi104 bash[15781]: audit 2024-09-15T03:31:27.140357+0000 mon.a (mon.0) 1244 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[21662]: audit 2024-09-15T03:31:28.159645+0000 mgr.y (mgr.24494) 148 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:29.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[21662]: audit 2024-09-15T03:31:28.504223+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[21662]: audit 2024-09-15T03:31:28.510302+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[21662]: audit 2024-09-15T03:31:28.517951+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[15077]: audit 2024-09-15T03:31:28.159645+0000 mgr.y (mgr.24494) 148 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:29.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[15077]: audit 2024-09-15T03:31:28.504223+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[15077]: audit 2024-09-15T03:31:28.510302+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:29 smithi053 bash[15077]: audit 2024-09-15T03:31:28.517951+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:29 smithi104 bash[15781]: audit 2024-09-15T03:31:28.159645+0000 mgr.y (mgr.24494) 148 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:29.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:29 smithi104 bash[15781]: audit 2024-09-15T03:31:28.504223+0000 mon.a (mon.0) 1245 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:29 smithi104 bash[15781]: audit 2024-09-15T03:31:28.510302+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:29 smithi104 bash[15781]: audit 2024-09-15T03:31:28.517951+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:29.711 INFO:teuthology.orchestra.run.smithi053.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:agent.smithi053 smithi053 running 2s ago 14m - - 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:agent.smithi104 smithi104 running 1s ago 13m - - 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager.a smithi053 *:9093,9094 running (2m) 2s ago 2m 15.0M - 0.25.0 c8568f914cd2 d5d93cfd82b9 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:grafana.a smithi104 *:3000 running (2m) 1s ago 2m 78.6M - 9.4.7 954c08fa6188 a064ee664f9c 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:iscsi.iscsi.a smithi104 *:5000 running (3m) 1s ago 3m 47.4M - 3.8 5c88729ed6d5 ac021dc9643b 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.x smithi104 *:8443 running (12m) 1s ago 12m 389M - 17.2.7-1643-gd75f2382 5c88729ed6d5 c9bc08c7f758 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:mgr.y smithi053 *:9283,8765 running (15m) 2s ago 15m 450M - 17.2.7-1643-gd75f2382 5c88729ed6d5 e9b1f4dbb961 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:mon.a smithi053 running (15m) 2s ago 15m 53.1M 2048M 17.2.7-1643-gd75f2382 5c88729ed6d5 8eb4face1c5c 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:mon.b smithi104 running (13m) 1s ago 13m 42.9M 2048M 17.2.7-1643-gd75f2382 5c88729ed6d5 bda8f3c5d057 2024-09-15T03:31:29.712 INFO:teuthology.orchestra.run.smithi053.stdout:mon.c smithi053 running (13m) 2s ago 13m 39.5M 2048M 17.2.7-1643-gd75f2382 5c88729ed6d5 3805fd5f8de3 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.a smithi053 *:9100 running (2m) 2s ago 3m 8263k - 1.5.0 0da6a335fe13 7e0e13ffbfd6 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter.b smithi104 *:9100 running (2m) 1s ago 2m 8475k - 1.5.0 0da6a335fe13 2cc44956c8c4 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.0 smithi053 running (11m) 2s ago 11m 49.5M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 cbf55b7a8aec 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.1 smithi053 running (10m) 2s ago 10m 50.3M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 1dc93d58f389 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.2 smithi053 running (9m) 2s ago 9m 47.0M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 f7e70d42b50a 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.3 smithi053 running (8m) 2s ago 8m 47.9M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 464176b3d43e 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.4 smithi104 running (7m) 1s ago 7m 49.8M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 50685ae0fd82 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.5 smithi104 running (6m) 1s ago 6m 45.2M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 f06d1d560984 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.6 smithi104 running (5m) 1s ago 5m 45.3M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 1b69c235126b 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:osd.7 smithi104 running (4m) 1s ago 4m 47.1M 4096M 17.2.7-1643-gd75f2382 5c88729ed6d5 61a32bdcf096 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus.a smithi104 *:9095 running (2m) 1s ago 3m 44.3M - 2.43.0 a07b618ecd1d fabf176ad96b 2024-09-15T03:31:29.713 INFO:teuthology.orchestra.run.smithi053.stdout:rgw.foo.a smithi053 *:80 running (4m) 2s ago 4m 81.4M - 17.2.7-1643-gd75f2382 5c88729ed6d5 32ae2b76d5ba 2024-09-15T03:31:30.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:30 smithi053 bash[21662]: cluster 2024-09-15T03:31:29.072923+0000 mgr.y (mgr.24494) 149 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:30.191 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:30 smithi053 bash[15077]: cluster 2024-09-15T03:31:29.072923+0000 mgr.y (mgr.24494) 149 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:30.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:30 smithi104 bash[15781]: cluster 2024-09-15T03:31:29.072923+0000 mgr.y (mgr.24494) 149 : cluster [DBG] pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:30.560 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T03:31:31.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[15077]: audit 2024-09-15T03:31:29.689563+0000 mgr.y (mgr.24494) 150 : audit [DBG] from='client.14757 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:31.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[15077]: audit 2024-09-15T03:31:30.853983+0000 mon.a (mon.0) 1248 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:31:31.143 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[15077]: audit 2024-09-15T03:31:30.856387+0000 mon.a (mon.0) 1249 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:31:31.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[15077]: audit 2024-09-15T03:31:30.857533+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:31:31.144 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[15077]: audit 2024-09-15T03:31:30.865055+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:31.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[21662]: audit 2024-09-15T03:31:29.689563+0000 mgr.y (mgr.24494) 150 : audit [DBG] from='client.14757 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:31.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[21662]: audit 2024-09-15T03:31:30.853983+0000 mon.a (mon.0) 1248 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:31:31.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[21662]: audit 2024-09-15T03:31:30.856387+0000 mon.a (mon.0) 1249 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:31:31.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[21662]: audit 2024-09-15T03:31:30.857533+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:31:31.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:31 smithi053 bash[21662]: audit 2024-09-15T03:31:30.865055+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:31.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:31 smithi104 bash[15781]: audit 2024-09-15T03:31:29.689563+0000 mgr.y (mgr.24494) 150 : audit [DBG] from='client.14757 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:31.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:31 smithi104 bash[15781]: audit 2024-09-15T03:31:30.853983+0000 mon.a (mon.0) 1248 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T03:31:31.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:31 smithi104 bash[15781]: audit 2024-09-15T03:31:30.856387+0000 mon.a (mon.0) 1249 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T03:31:31.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:31 smithi104 bash[15781]: audit 2024-09-15T03:31:30.857533+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T03:31:31.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:31 smithi104 bash[15781]: audit 2024-09-15T03:31:30.865055+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:32.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:32 smithi053 bash[15077]: cluster 2024-09-15T03:31:31.073619+0000 mgr.y (mgr.24494) 151 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:32.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:32 smithi053 bash[21662]: cluster 2024-09-15T03:31:31.073619+0000 mgr.y (mgr.24494) 151 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:32.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:32 smithi104 bash[15781]: cluster 2024-09-15T03:31:31.073619+0000 mgr.y (mgr.24494) 151 : cluster [DBG] pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:33.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:31:32 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:32] "GET /metrics HTTP/1.1" 200 219613 "" "Prometheus/2.43.0" 2024-09-15T03:31:34.440 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:34 smithi053 bash[21662]: cluster 2024-09-15T03:31:33.075010+0000 mgr.y (mgr.24494) 152 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:34.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:34 smithi053 bash[15077]: cluster 2024-09-15T03:31:33.075010+0000 mgr.y (mgr.24494) 152 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:34.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:31:34 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:34] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:31:34.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:34 smithi104 bash[15781]: cluster 2024-09-15T03:31:33.075010+0000 mgr.y (mgr.24494) 152 : cluster [DBG] pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:35.352 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:31:36.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:36 smithi053 bash[15077]: cluster 2024-09-15T03:31:35.075654+0000 mgr.y (mgr.24494) 153 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:36.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:36 smithi053 bash[21662]: cluster 2024-09-15T03:31:35.075654+0000 mgr.y (mgr.24494) 153 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:36.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:36 smithi104 bash[15781]: cluster 2024-09-15T03:31:35.075654+0000 mgr.y (mgr.24494) 153 : cluster [DBG] pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:38.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:38 smithi053 bash[15077]: cluster 2024-09-15T03:31:37.076359+0000 mgr.y (mgr.24494) 154 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:38.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:38 smithi053 bash[21662]: cluster 2024-09-15T03:31:37.076359+0000 mgr.y (mgr.24494) 154 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:38.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:38 smithi104 bash[15781]: cluster 2024-09-15T03:31:37.076359+0000 mgr.y (mgr.24494) 154 : cluster [DBG] pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:38.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:31:38 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:31:38.528 INFO:teuthology.orchestra.run.smithi053.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T03:31:38.528 INFO:teuthology.orchestra.run.smithi053.stdout:agent 2/2 11s ago 3m * 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:alertmanager ?:9093,9094 1/1 11s ago 3m smithi053=a;count:1 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:grafana ?:3000 1/1 10s ago 2m smithi104=a;count:1 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:iscsi.datapool ?:5000 1/1 10s ago 3m smithi104=iscsi.a;count:1 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:mgr 2/2 11s ago 12m smithi053=y;smithi104=x;count:2 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:mon 3/3 11s ago 13m smithi053:172.21.15.53=a;smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c;smithi104:172.21.15.104=b;count:3 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:node-exporter ?:9100 2/2 11s ago 3m smithi053=a;smithi104=b;count:2 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:osd 8 11s ago - 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:prometheus ?:9095 1/1 10s ago 3m smithi104=a;count:1 2024-09-15T03:31:38.529 INFO:teuthology.orchestra.run.smithi053.stdout:rgw.foo.a ?:80 1/1 11s ago 4m smithi053=foo.a;count:1 2024-09-15T03:31:39.131 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T03:31:39.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:39 smithi053 bash[21662]: audit 2024-09-15T03:31:38.168644+0000 mgr.y (mgr.24494) 155 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:39.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:39 smithi053 bash[15077]: audit 2024-09-15T03:31:38.168644+0000 mgr.y (mgr.24494) 155 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:39.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:39 smithi104 bash[15781]: audit 2024-09-15T03:31:38.168644+0000 mgr.y (mgr.24494) 155 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:40.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:40 smithi053 bash[15077]: audit 2024-09-15T03:31:38.515222+0000 mgr.y (mgr.24494) 156 : audit [DBG] from='client.24692 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:40.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:40 smithi053 bash[15077]: cluster 2024-09-15T03:31:39.077750+0000 mgr.y (mgr.24494) 157 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:40 smithi053 bash[21662]: audit 2024-09-15T03:31:38.515222+0000 mgr.y (mgr.24494) 156 : audit [DBG] from='client.24692 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:40.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:40 smithi053 bash[21662]: cluster 2024-09-15T03:31:39.077750+0000 mgr.y (mgr.24494) 157 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:40.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:40 smithi104 bash[15781]: audit 2024-09-15T03:31:38.515222+0000 mgr.y (mgr.24494) 156 : audit [DBG] from='client.24692 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:40.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:40 smithi104 bash[15781]: cluster 2024-09-15T03:31:39.077750+0000 mgr.y (mgr.24494) 157 : cluster [DBG] pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:42.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:42 smithi053 bash[15077]: cluster 2024-09-15T03:31:41.078449+0000 mgr.y (mgr.24494) 158 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:42.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:42 smithi053 bash[15077]: audit 2024-09-15T03:31:42.091311+0000 mon.a (mon.0) 1252 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:42.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:42 smithi053 bash[21662]: cluster 2024-09-15T03:31:41.078449+0000 mgr.y (mgr.24494) 158 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:42.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:42 smithi053 bash[21662]: audit 2024-09-15T03:31:42.091311+0000 mon.a (mon.0) 1252 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:42 smithi104 bash[15781]: cluster 2024-09-15T03:31:41.078449+0000 mgr.y (mgr.24494) 158 : cluster [DBG] pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:42.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:42 smithi104 bash[15781]: audit 2024-09-15T03:31:42.091311+0000 mon.a (mon.0) 1252 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:43.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:31:42 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:42] "GET /metrics HTTP/1.1" 200 219614 "" "Prometheus/2.43.0" 2024-09-15T03:31:43.913 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:31:44.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:44 smithi053 bash[21662]: cluster 2024-09-15T03:31:43.079838+0000 mgr.y (mgr.24494) 159 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:44.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:44 smithi053 bash[15077]: cluster 2024-09-15T03:31:43.079838+0000 mgr.y (mgr.24494) 159 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:44.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:44 smithi104 bash[15781]: cluster 2024-09-15T03:31:43.079838+0000 mgr.y (mgr.24494) 159 : cluster [DBG] pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:44.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:31:44 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:44] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:31:46.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:46 smithi053 bash[15077]: cluster 2024-09-15T03:31:45.080596+0000 mgr.y (mgr.24494) 160 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:46.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:46 smithi053 bash[21662]: cluster 2024-09-15T03:31:45.080596+0000 mgr.y (mgr.24494) 160 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:46.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:46 smithi104 bash[15781]: cluster 2024-09-15T03:31:45.080596+0000 mgr.y (mgr.24494) 160 : cluster [DBG] pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:47.713 INFO:teuthology.orchestra.run.smithi053.stdout:HOST ADDR LABELS STATUS 2024-09-15T03:31:47.713 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 172.21.15.53 2024-09-15T03:31:47.713 INFO:teuthology.orchestra.run.smithi053.stdout:smithi104 172.21.15.104 2024-09-15T03:31:47.713 INFO:teuthology.orchestra.run.smithi053.stdout:2 hosts in cluster 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[15077]: cluster 2024-09-15T03:31:47.081273+0000 mgr.y (mgr.24494) 161 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[15077]: audit 2024-09-15T03:31:47.348326+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[15077]: audit 2024-09-15T03:31:47.356561+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[15077]: audit 2024-09-15T03:31:47.363326+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[21662]: cluster 2024-09-15T03:31:47.081273+0000 mgr.y (mgr.24494) 161 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[21662]: audit 2024-09-15T03:31:47.348326+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[21662]: audit 2024-09-15T03:31:47.356561+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:48 smithi053 bash[21662]: audit 2024-09-15T03:31:47.363326+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:31:48 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:31:48.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:48 smithi104 bash[15781]: cluster 2024-09-15T03:31:47.081273+0000 mgr.y (mgr.24494) 161 : cluster [DBG] pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:48.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:48 smithi104 bash[15781]: audit 2024-09-15T03:31:47.348326+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:48 smithi104 bash[15781]: audit 2024-09-15T03:31:47.356561+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:48.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:48 smithi104 bash[15781]: audit 2024-09-15T03:31:47.363326+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.128 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[21662]: audit 2024-09-15T03:31:47.710942+0000 mgr.y (mgr.24494) 162 : audit [DBG] from='client.14769 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[21662]: audit 2024-09-15T03:31:48.179905+0000 mgr.y (mgr.24494) 163 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[21662]: audit 2024-09-15T03:31:48.677920+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[21662]: audit 2024-09-15T03:31:48.683257+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[21662]: audit 2024-09-15T03:31:48.688757+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[15077]: audit 2024-09-15T03:31:47.710942+0000 mgr.y (mgr.24494) 162 : audit [DBG] from='client.14769 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[15077]: audit 2024-09-15T03:31:48.179905+0000 mgr.y (mgr.24494) 163 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[15077]: audit 2024-09-15T03:31:48.677920+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[15077]: audit 2024-09-15T03:31:48.683257+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.442 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:49 smithi053 bash[15077]: audit 2024-09-15T03:31:48.688757+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:49 smithi104 bash[15781]: audit 2024-09-15T03:31:47.710942+0000 mgr.y (mgr.24494) 162 : audit [DBG] from='client.14769 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:49.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:49 smithi104 bash[15781]: audit 2024-09-15T03:31:48.179905+0000 mgr.y (mgr.24494) 163 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:49.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:49 smithi104 bash[15781]: audit 2024-09-15T03:31:48.677920+0000 mon.a (mon.0) 1256 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:49 smithi104 bash[15781]: audit 2024-09-15T03:31:48.683257+0000 mon.a (mon.0) 1257 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:49.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:49 smithi104 bash[15781]: audit 2024-09-15T03:31:48.688757+0000 mon.a (mon.0) 1258 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:31:50.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:50 smithi053 bash[15077]: cluster 2024-09-15T03:31:49.082715+0000 mgr.y (mgr.24494) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:50.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:50 smithi053 bash[21662]: cluster 2024-09-15T03:31:49.082715+0000 mgr.y (mgr.24494) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:50.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:50 smithi104 bash[15781]: cluster 2024-09-15T03:31:49.082715+0000 mgr.y (mgr.24494) 164 : cluster [DBG] pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:52.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:52 smithi053 bash[21662]: cluster 2024-09-15T03:31:51.083386+0000 mgr.y (mgr.24494) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:52.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:52 smithi053 bash[15077]: cluster 2024-09-15T03:31:51.083386+0000 mgr.y (mgr.24494) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:52.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:52 smithi104 bash[15781]: cluster 2024-09-15T03:31:51.083386+0000 mgr.y (mgr.24494) 165 : cluster [DBG] pgmap v105: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:53.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:31:52 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:52] "GET /metrics HTTP/1.1" 200 219614 "" "Prometheus/2.43.0" 2024-09-15T03:31:54.198 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:31:54.360 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:31:54 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:31:54] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:31:54.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:54 smithi053 bash[21662]: cluster 2024-09-15T03:31:53.084801+0000 mgr.y (mgr.24494) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:54.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:54 smithi053 bash[15077]: cluster 2024-09-15T03:31:53.084801+0000 mgr.y (mgr.24494) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:54.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:54 smithi104 bash[15781]: cluster 2024-09-15T03:31:53.084801+0000 mgr.y (mgr.24494) 166 : cluster [DBG] pgmap v106: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:56.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:56 smithi053 bash[21662]: cluster 2024-09-15T03:31:55.085338+0000 mgr.y (mgr.24494) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:56.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:56 smithi053 bash[15077]: cluster 2024-09-15T03:31:55.085338+0000 mgr.y (mgr.24494) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:56.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:56 smithi104 bash[15781]: cluster 2024-09-15T03:31:55.085338+0000 mgr.y (mgr.24494) 167 : cluster [DBG] pgmap v107: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:57.446 INFO:teuthology.orchestra.run.smithi053.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T03:31:57.446 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300G8480DGN 447G No 10s ago Has a FileSystem, LVM detected 2024-09-15T03:31:57.446 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/nvme1n1 ssd Linux_06acf8e08d56151df8fe 89.4G No 10s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/nvme2n1 ssd Linux_d2eaff4cb325d0aa3804 89.4G No 10s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/nvme3n1 ssd Linux_6097b62f26c6088faba0 89.4G No 10s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/nvme4n1 ssd Linux_bd1f82b910b6c9653a6d 89.4G No 10s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053 /dev/sda hdd ST1000NM0033-9ZM173_Z1W4J2LS 931G No 10s ago Has partitions 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi104 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NW400BGN 372G No 8s ago Has a FileSystem, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi104 /dev/nvme1n1 ssd Linux_6ac73f896f29086606ab 89.4G No 8s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi104 /dev/nvme2n1 ssd Linux_0c7a36dbe289990b1bb2 89.4G No 8s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi104 /dev/nvme3n1 ssd Linux_a42c440931d6b58411a5 89.4G No 8s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi104 /dev/nvme4n1 ssd Linux_7ebeddb4a4c99ecb5ef3 89.4G No 8s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-15T03:31:57.447 INFO:teuthology.orchestra.run.smithi053.stdout:smithi104 /dev/sda hdd ST1000NM0033-9ZM173_Z1W5QGJ7 931G No 8s ago Has partitions 2024-09-15T03:31:57.629 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:57 smithi053 bash[21662]: audit 2024-09-15T03:31:57.091611+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:57.629 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:57 smithi053 bash[15077]: audit 2024-09-15T03:31:57.091611+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:57.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:57 smithi104 bash[15781]: audit 2024-09-15T03:31:57.091611+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:31:58.101 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls --format yaml' 2024-09-15T03:31:58.368 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:31:58 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:31:58.690 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:58 smithi053 bash[15077]: cluster 2024-09-15T03:31:57.085808+0000 mgr.y (mgr.24494) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:58.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:58 smithi053 bash[15077]: audit 2024-09-15T03:31:57.435521+0000 mgr.y (mgr.24494) 169 : audit [DBG] from='client.24704 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:58.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:58 smithi053 bash[15077]: audit 2024-09-15T03:31:58.187611+0000 mgr.y (mgr.24494) 170 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:58.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:58 smithi053 bash[21662]: cluster 2024-09-15T03:31:57.085808+0000 mgr.y (mgr.24494) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:58.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:58 smithi053 bash[21662]: audit 2024-09-15T03:31:57.435521+0000 mgr.y (mgr.24494) 169 : audit [DBG] from='client.24704 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:58.691 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:58 smithi053 bash[21662]: audit 2024-09-15T03:31:58.187611+0000 mgr.y (mgr.24494) 170 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:58.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:58 smithi104 bash[15781]: cluster 2024-09-15T03:31:57.085808+0000 mgr.y (mgr.24494) 168 : cluster [DBG] pgmap v108: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:31:58.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:58 smithi104 bash[15781]: audit 2024-09-15T03:31:57.435521+0000 mgr.y (mgr.24494) 169 : audit [DBG] from='client.24704 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T03:31:58.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:58 smithi104 bash[15781]: audit 2024-09-15T03:31:58.187611+0000 mgr.y (mgr.24494) 170 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:31:59.690 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:31:59 smithi053 bash[21662]: cluster 2024-09-15T03:31:59.086610+0000 mgr.y (mgr.24494) 171 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:59.691 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:31:59 smithi053 bash[15077]: cluster 2024-09-15T03:31:59.086610+0000 mgr.y (mgr.24494) 171 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:31:59.735 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:31:59 smithi104 bash[15781]: cluster 2024-09-15T03:31:59.086610+0000 mgr.y (mgr.24494) 171 : cluster [DBG] pgmap v109: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:02.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:02 smithi053 bash[15077]: cluster 2024-09-15T03:32:01.087264+0000 mgr.y (mgr.24494) 172 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:02.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:02 smithi053 bash[21662]: cluster 2024-09-15T03:32:01.087264+0000 mgr.y (mgr.24494) 172 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:02.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:02 smithi104 bash[15781]: cluster 2024-09-15T03:32:01.087264+0000 mgr.y (mgr.24494) 172 : cluster [DBG] pgmap v110: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:02.884 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:32:03.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:02 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:32:02] "GET /metrics HTTP/1.1" 200 219607 "" "Prometheus/2.43.0" 2024-09-15T03:32:04.286 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:04 smithi053 bash[15077]: cluster 2024-09-15T03:32:03.088252+0000 mgr.y (mgr.24494) 173 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:04.287 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:04 smithi053 bash[21662]: cluster 2024-09-15T03:32:03.088252+0000 mgr.y (mgr.24494) 173 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:04.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:04 smithi104 bash[15781]: cluster 2024-09-15T03:32:03.088252+0000 mgr.y (mgr.24494) 173 : cluster [DBG] pgmap v111: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:04.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:32:04 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:32:04] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:32:06.190 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:05 smithi053 bash[15077]: cluster 2024-09-15T03:32:05.088929+0000 mgr.y (mgr.24494) 174 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:06.191 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:05 smithi053 bash[21662]: cluster 2024-09-15T03:32:05.088929+0000 mgr.y (mgr.24494) 174 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:06.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:05 smithi104 bash[15781]: cluster 2024-09-15T03:32:05.088929+0000 mgr.y (mgr.24494) 174 : cluster [DBG] pgmap v112: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:06.249 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: agent 2024-09-15T03:32:06.249 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: agent 2024-09-15T03:32:06.249 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.249 INFO:teuthology.orchestra.run.smithi053.stdout: host_pattern: '*' 2024-09-15T03:32:06.249 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.249 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:28:27.049428Z' 2024-09-15T03:32:06.249 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:47.338662Z' 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: running: 2 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: size: 2 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout:events: 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout:- 2024-09-15T03:28:28.251946Z service:agent [INFO] "service was created" 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: alertmanager 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: alertmanager 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: count: 1 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi053=a 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:28:28.005519Z' 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:47.339603Z' 2024-09-15T03:32:06.250 INFO:teuthology.orchestra.run.smithi053.stdout: ports: 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout: - 9093 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout: - 9094 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout: running: 1 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout: size: 1 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout:events: 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout:- 2024-09-15T03:28:42.530242Z service:alertmanager [INFO] "service was created" 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: grafana 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: grafana 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout: count: 1 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.251 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi104=a 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout:spec: 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout: anonymous_access: true 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:28:40.401446Z' 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:48.671369Z' 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout: ports: 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout: - 3000 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout: running: 1 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout: size: 1 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout:events: 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout:- 2024-09-15T03:29:19.935583Z service:grafana [INFO] "service was created" 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.252 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: iscsi 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout:service_id: datapool 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: iscsi.datapool 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: count: 1 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi104=iscsi.a 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout:spec: 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: api_password: admin 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: api_port: 5000 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: api_user: admin 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: pool: datapool 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: trusted_ip_list: 172.21.15.104 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.253 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:27:49.107528Z' 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:48.671050Z' 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: ports: 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: - 5000 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: running: 1 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: size: 1 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: mgr 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: mgr 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: count: 2 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi053=y 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi104=x 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.254 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:18:51.709609Z' 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:47.338529Z' 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: running: 2 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: size: 2 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: mon 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: mon 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: count: 3 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi053:172.21.15.53=a 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi053:[v2:172.21.15.53:3301,v1:172.21.15.53:6790]=c 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi104:172.21.15.104=b 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.255 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:18:11.765540Z' 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:47.338333Z' 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: running: 3 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: size: 3 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: node-exporter 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: node-exporter 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: count: 2 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi053=a 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi104=b 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:28:14.189916Z' 2024-09-15T03:32:06.256 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:47.339480Z' 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout: ports: 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout: - 9100 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout: running: 2 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout: size: 2 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:events: 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:- 2024-09-15T03:28:30.311943Z service:node-exporter [INFO] "service was created" 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: osd 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: osd 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:unmanaged: true 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:spec: 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout: filter_logic: AND 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout: objectstore: bluestore 2024-09-15T03:32:06.257 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: container_image_id: 5c88729ed6d5bf43038296d22a5895511cd0af7c2172156b411462c2685712d0 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: container_image_name: quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:b74feaf32e117a824018a514c6386b2ab812fa0078f0a1365fcf1c4c7be8bdac 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:47.338864Z' 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: running: 8 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: size: 8 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: prometheus 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: prometheus 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: count: 1 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi104=a 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:28:01.395692Z' 2024-09-15T03:32:06.258 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:48.671156Z' 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: ports: 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: - 9095 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: running: 1 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: size: 1 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:events: 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:- 2024-09-15T03:28:30.324460Z service:prometheus [INFO] "service was created" 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:--- 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:service_type: rgw 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:service_id: foo.a 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:service_name: rgw.foo.a 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:placement: 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: count: 1 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: hosts: 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout: - smithi053=foo.a 2024-09-15T03:32:06.259 INFO:teuthology.orchestra.run.smithi053.stdout:status: 2024-09-15T03:32:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: created: '2024-09-15T03:27:22.343233Z' 2024-09-15T03:32:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: last_refresh: '2024-09-15T03:31:47.339355Z' 2024-09-15T03:32:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: ports: 2024-09-15T03:32:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: - 80 2024-09-15T03:32:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: running: 1 2024-09-15T03:32:06.260 INFO:teuthology.orchestra.run.smithi053.stdout: size: 1 2024-09-15T03:32:07.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:06 smithi104 bash[15781]: audit 2024-09-15T03:32:06.222246+0000 mgr.y (mgr.24494) 175 : audit [DBG] from='client.14781 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2024-09-15T03:32:07.302 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:06 smithi053 bash[15077]: audit 2024-09-15T03:32:06.222246+0000 mgr.y (mgr.24494) 175 : audit [DBG] from='client.14781 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2024-09-15T03:32:07.302 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:06 smithi053 bash[21662]: audit 2024-09-15T03:32:06.222246+0000 mgr.y (mgr.24494) 175 : audit [DBG] from='client.14781 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2024-09-15T03:32:07.305 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d75f23820806da622f561ee5ee7551015285993f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid aed93852-7310-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-09-15T03:32:08.304 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[15077]: cluster 2024-09-15T03:32:07.089617+0000 mgr.y (mgr.24494) 176 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:32:08.305 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[15077]: audit 2024-09-15T03:32:07.560367+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.305 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[15077]: audit 2024-09-15T03:32:07.567005+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.305 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[15077]: audit 2024-09-15T03:32:07.573604+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[21662]: cluster 2024-09-15T03:32:07.089617+0000 mgr.y (mgr.24494) 176 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:32:08.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[21662]: audit 2024-09-15T03:32:07.560367+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[21662]: audit 2024-09-15T03:32:07.567005+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.306 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:07 smithi053 bash[21662]: audit 2024-09-15T03:32:07.573604+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:32:08 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:32:08.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:07 smithi104 bash[15781]: cluster 2024-09-15T03:32:07.089617+0000 mgr.y (mgr.24494) 176 : cluster [DBG] pgmap v113: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-09-15T03:32:08.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:07 smithi104 bash[15781]: audit 2024-09-15T03:32:07.560367+0000 mon.a (mon.0) 1260 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:07 smithi104 bash[15781]: audit 2024-09-15T03:32:07.567005+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:08.486 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:07 smithi104 bash[15781]: audit 2024-09-15T03:32:07.573604+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:08 smithi104 bash[15781]: audit 2024-09-15T03:32:08.199054+0000 mgr.y (mgr.24494) 177 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:32:09.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:08 smithi104 bash[15781]: audit 2024-09-15T03:32:08.900281+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:08 smithi104 bash[15781]: audit 2024-09-15T03:32:08.907163+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.236 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:08 smithi104 bash[15781]: audit 2024-09-15T03:32:08.914448+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.267 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[15077]: audit 2024-09-15T03:32:08.199054+0000 mgr.y (mgr.24494) 177 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:32:09.268 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[15077]: audit 2024-09-15T03:32:08.900281+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.268 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[15077]: audit 2024-09-15T03:32:08.907163+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.268 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[15077]: audit 2024-09-15T03:32:08.914448+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.268 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[21662]: audit 2024-09-15T03:32:08.199054+0000 mgr.y (mgr.24494) 177 : audit [DBG] from='client.24478 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-09-15T03:32:09.268 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[21662]: audit 2024-09-15T03:32:08.900281+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.268 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[21662]: audit 2024-09-15T03:32:08.907163+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:09.268 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:08 smithi053 bash[21662]: audit 2024-09-15T03:32:08.914448+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' 2024-09-15T03:32:10.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:09 smithi053 bash[21662]: cluster 2024-09-15T03:32:09.090658+0000 mgr.y (mgr.24494) 178 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:10.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:09 smithi053 bash[15077]: cluster 2024-09-15T03:32:09.090658+0000 mgr.y (mgr.24494) 178 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:10.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:09 smithi104 bash[15781]: cluster 2024-09-15T03:32:09.090658+0000 mgr.y (mgr.24494) 178 : cluster [DBG] pgmap v114: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:12.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:12 smithi053 bash[21662]: cluster 2024-09-15T03:32:11.091225+0000 mgr.y (mgr.24494) 179 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:12.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:12 smithi053 bash[21662]: audit 2024-09-15T03:32:12.092379+0000 mon.a (mon.0) 1266 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:32:12.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:12 smithi053 bash[15077]: cluster 2024-09-15T03:32:11.091225+0000 mgr.y (mgr.24494) 179 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:12.441 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:12 smithi053 bash[15077]: audit 2024-09-15T03:32:12.092379+0000 mon.a (mon.0) 1266 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:32:12.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:12 smithi104 bash[15781]: cluster 2024-09-15T03:32:11.091225+0000 mgr.y (mgr.24494) 179 : cluster [DBG] pgmap v115: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:12.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:12 smithi104 bash[15781]: audit 2024-09-15T03:32:12.092379+0000 mon.a (mon.0) 1266 : audit [DBG] from='mgr.24494 172.21.15.53:0/3974917296' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-15T03:32:13.190 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:12 smithi053 bash[15335]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:32:12] "GET /metrics HTTP/1.1" 200 219612 "" "Prometheus/2.43.0" 2024-09-15T03:32:13.783 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T03:32:14.153 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:14 smithi053 bash[15077]: cluster 2024-09-15T03:32:13.092582+0000 mgr.y (mgr.24494) 180 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:14.190 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:14 smithi053 bash[21662]: cluster 2024-09-15T03:32:13.092582+0000 mgr.y (mgr.24494) 180 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:14.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:14 smithi104 bash[15781]: cluster 2024-09-15T03:32:13.092582+0000 mgr.y (mgr.24494) 180 : cluster [DBG] pgmap v116: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T03:32:14.485 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:32:14 smithi104 bash[17508]: ::ffff:172.21.15.104 - - [15/Sep/2024:03:32:14] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.43.0" 2024-09-15T03:32:16.440 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:16 smithi053 bash[15077]: cluster 2024-09-15T03:32:15.093260+0000 mgr.y (mgr.24494) 181 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:16.441 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:16 smithi053 bash[21662]: cluster 2024-09-15T03:32:15.093260+0000 mgr.y (mgr.24494) 181 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:16.485 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:16 smithi104 bash[15781]: cluster 2024-09-15T03:32:15.093260+0000 mgr.y (mgr.24494) 181 : cluster [DBG] pgmap v117: 132 pgs: 132 active+clean; 582 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-09-15T03:32:17.089 INFO:teuthology.orchestra.run.smithi053.stdout:osd 8 9s ago - 2024-09-15T03:32:17.727 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T03:32:17.738 INFO:tasks.cephadm:Teardown begin 2024-09-15T03:32:17.739 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T03:32:17.756 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T03:32:17.773 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T03:32:17.774 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T03:32:17.803 DEBUG:teuthology.orchestra.run.smithi104:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T03:32:17.822 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T03:32:17.822 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T03:32:17.822 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a 2024-09-15T03:32:18.031 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:17 smithi053 systemd[1]: Stopping Ceph mon.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:18.318 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15335]: [15/Sep/2024:03:32:18] ENGINE Bus STOPPING 2024-09-15T03:32:18.318 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15077]: debug 2024-09-15T03:32:18.025+0000 7f9323b41640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-15T03:32:18.318 INFO:journalctl@ceph.mon.a.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15077]: debug 2024-09-15T03:32:18.025+0000 7f9323b41640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T03:32:18.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:32:18 smithi104 bash[39933]: debug there is no tcmu-runner data available 2024-09-15T03:32:18.690 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15335]: [15/Sep/2024:03:32:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-15T03:32:18.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15335]: [15/Sep/2024:03:32:18] ENGINE Bus STOPPED 2024-09-15T03:32:18.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15335]: [15/Sep/2024:03:32:18] ENGINE Bus STARTING 2024-09-15T03:32:18.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15335]: [15/Sep/2024:03:32:18] ENGINE Serving on http://:::9283 2024-09-15T03:32:18.691 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:18 smithi053 bash[15335]: [15/Sep/2024:03:32:18] ENGINE Bus STARTED 2024-09-15T03:32:18.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T03:32:18.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:18.942 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T03:32:18.943 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-09-15T03:32:18.943 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.c 2024-09-15T03:32:19.376 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[15335]: [15/Sep/2024:03:32:19] ENGINE Bus STOPPING 2024-09-15T03:32:19.377 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:19 smithi053 systemd[1]: Stopping Ceph mon.c for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:19.377 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[21662]: debug 2024-09-15T03:32:19.157+0000 7fe9635e2640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-15T03:32:19.377 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[21662]: debug 2024-09-15T03:32:19.157+0000 7fe9635e2640 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T03:32:19.632 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[15335]: [15/Sep/2024:03:32:19] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-15T03:32:19.632 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[15335]: [15/Sep/2024:03:32:19] ENGINE Bus STOPPED 2024-09-15T03:32:19.632 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[15335]: [15/Sep/2024:03:32:19] ENGINE Bus STARTING 2024-09-15T03:32:19.632 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[15335]: [15/Sep/2024:03:32:19] ENGINE Serving on http://:::9283 2024-09-15T03:32:19.632 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[15335]: [15/Sep/2024:03:32:19] ENGINE Bus STARTED 2024-09-15T03:32:19.894 INFO:journalctl@ceph.mon.c.smithi053.stdout:Sep 15 03:32:19 smithi053 bash[60356]: ceph-aed93852-7310-11ef-bceb-c7b262605968-mon-c 2024-09-15T03:32:19.899 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T03:32:19.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:19.931 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-09-15T03:32:19.931 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-09-15T03:32:19.932 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.b 2024-09-15T03:32:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:19 smithi104 systemd[1]: Stopping Ceph mon.b for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:20 smithi104 bash[15781]: debug 2024-09-15T03:32:20.067+0000 7f606e407640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-09-15T03:32:20.235 INFO:journalctl@ceph.mon.b.smithi104.stdout:Sep 15 03:32:20 smithi104 bash[15781]: debug 2024-09-15T03:32:20.067+0000 7f606e407640 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T03:32:21.102 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T03:32:21.135 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:21.135 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-09-15T03:32:21.136 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T03:32:21.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.y 2024-09-15T03:32:21.440 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:21 smithi053 systemd[1]: Stopping Ceph mgr.y for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:21.441 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 15 03:32:21 smithi053 bash[15335]: debug 2024-09-15T03:32:21.297+0000 7f748ed01640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:32:21.984 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T03:32:22.016 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:22.016 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T03:32:22.017 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T03:32:22.017 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.x 2024-09-15T03:32:22.283 INFO:journalctl@ceph.mgr.x.smithi104.stdout:Sep 15 03:32:22 smithi104 systemd[1]: Stopping Ceph mgr.x for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:23.095 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T03:32:23.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:23.129 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T03:32:23.129 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T03:32:23.129 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.0 2024-09-15T03:32:23.441 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 15 03:32:23 smithi053 systemd[1]: Stopping Ceph osd.0 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:23.441 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 15 03:32:23 smithi053 bash[26119]: debug 2024-09-15T03:32:23.309+0000 7fa1912cc640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:32:23.441 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 15 03:32:23 smithi053 bash[26119]: debug 2024-09-15T03:32:23.309+0000 7fa1912cc640 -1 osd.0 74 *** Got signal Terminated *** 2024-09-15T03:32:23.441 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 15 03:32:23 smithi053 bash[26119]: debug 2024-09-15T03:32:23.309+0000 7fa1912cc640 -1 osd.0 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:32:23.940 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:23 smithi053 bash[50091]: ts=2024-09-15T03:32:23.518Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:32:23.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:23 smithi053 bash[50091]: ts=2024-09-15T03:32:23.519Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:32:29.778 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 15 03:32:29 smithi053 bash[60587]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-0 2024-09-15T03:32:29.778 INFO:journalctl@ceph.osd.0.smithi053.stdout:Sep 15 03:32:29 smithi053 bash[61060]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-0 2024-09-15T03:32:31.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T03:32:32.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:32.028 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T03:32:32.028 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T03:32:32.028 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.1 2024-09-15T03:32:32.255 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:32:32 smithi053 systemd[1]: Stopping Ceph osd.1 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:32.691 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:32:32 smithi053 bash[30540]: debug 2024-09-15T03:32:32.248+0000 7f1ec6561640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:32:32.691 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:32:32 smithi053 bash[30540]: debug 2024-09-15T03:32:32.248+0000 7f1ec6561640 -1 osd.1 74 *** Got signal Terminated *** 2024-09-15T03:32:32.691 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:32:32 smithi053 bash[30540]: debug 2024-09-15T03:32:32.248+0000 7f1ec6561640 -1 osd.1 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:32:33.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:33 smithi053 bash[50091]: ts=2024-09-15T03:32:33.518Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:32:33.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:33 smithi053 bash[50091]: ts=2024-09-15T03:32:33.519Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:32:33.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:33 smithi053 bash[50091]: ts=2024-09-15T03:32:33.520Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:32:38.793 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:32:38 smithi053 bash[61495]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-1 2024-09-15T03:32:38.794 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 15 03:32:38 smithi053 bash[61565]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-1 2024-09-15T03:32:40.381 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T03:32:40.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:40.411 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T03:32:40.411 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T03:32:40.411 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.2 2024-09-15T03:32:40.639 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:40 smithi053 systemd[1]: Stopping Ceph osd.2 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:40.940 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:40 smithi053 bash[34507]: debug 2024-09-15T03:32:40.632+0000 7ff64ef2c640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:32:40.941 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:40 smithi053 bash[34507]: debug 2024-09-15T03:32:40.632+0000 7ff64ef2c640 -1 osd.2 74 *** Got signal Terminated *** 2024-09-15T03:32:40.941 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:40 smithi053 bash[34507]: debug 2024-09-15T03:32:40.632+0000 7ff64ef2c640 -1 osd.2 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:32:43.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:43 smithi053 bash[50091]: ts=2024-09-15T03:32:43.518Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:32:43.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:43 smithi053 bash[50091]: ts=2024-09-15T03:32:43.519Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:32:43.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:43 smithi053 bash[50091]: ts=2024-09-15T03:32:43.520Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:32:46.941 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:46 smithi053 bash[61702]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-2 2024-09-15T03:32:47.438 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:47 smithi053 bash[61796]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-2 2024-09-15T03:32:49.902 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T03:32:49.913 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:49 smithi053 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.2.service: Succeeded. 2024-09-15T03:32:49.913 INFO:journalctl@ceph.osd.2.smithi053.stdout:Sep 15 03:32:49 smithi053 systemd[1]: Stopped Ceph osd.2 for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:32:49.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:49.934 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T03:32:49.934 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T03:32:49.934 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.3 2024-09-15T03:32:50.190 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:49 smithi053 systemd[1]: Stopping Ceph osd.3 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:50.235 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:49 smithi104 bash[27846]: debug 2024-09-15T03:32:49.903+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:50.568 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:50 smithi053 bash[38868]: debug 2024-09-15T03:32:50.292+0000 7fb35ae6c640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:32:50.568 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:50 smithi053 bash[38868]: debug 2024-09-15T03:32:50.292+0000 7fb35ae6c640 -1 osd.3 74 *** Got signal Terminated *** 2024-09-15T03:32:50.568 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:50 smithi053 bash[38868]: debug 2024-09-15T03:32:50.292+0000 7fb35ae6c640 -1 osd.3 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:32:51.235 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:50 smithi104 bash[27846]: debug 2024-09-15T03:32:50.919+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:51.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:51 smithi104 bash[32268]: debug 2024-09-15T03:32:51.431+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:51.940 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:51 smithi053 bash[38868]: debug 2024-09-15T03:32:51.588+0000 7fb355480640 -1 osd.3 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.192912+0000 front 2024-09-15T03:32:25.192440+0000 (oldest deadline 2024-09-15T03:32:51.092441+0000) 2024-09-15T03:32:52.235 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:51 smithi104 bash[27846]: debug 2024-09-15T03:32:51.903+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:52.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:52 smithi104 bash[32268]: debug 2024-09-15T03:32:52.467+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:52.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:52 smithi104 bash[36607]: debug 2024-09-15T03:32:52.695+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:52.736 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:52 smithi104 bash[23755]: debug 2024-09-15T03:32:52.467+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:52.940 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:52 smithi053 bash[38868]: debug 2024-09-15T03:32:52.588+0000 7fb355480640 -1 osd.3 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.192912+0000 front 2024-09-15T03:32:25.192440+0000 (oldest deadline 2024-09-15T03:32:51.092441+0000) 2024-09-15T03:32:53.235 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:52 smithi104 bash[27846]: debug 2024-09-15T03:32:52.851+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:53.715 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:53 smithi104 bash[23755]: debug 2024-09-15T03:32:53.499+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:53.716 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:53 smithi104 bash[32268]: debug 2024-09-15T03:32:53.427+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:53.940 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:53 smithi053 bash[38868]: debug 2024-09-15T03:32:53.608+0000 7fb355480640 -1 osd.3 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.192912+0000 front 2024-09-15T03:32:25.192440+0000 (oldest deadline 2024-09-15T03:32:51.092441+0000) 2024-09-15T03:32:53.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:53 smithi053 bash[50091]: ts=2024-09-15T03:32:53.519Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:32:53.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:53 smithi053 bash[50091]: ts=2024-09-15T03:32:53.520Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:32:53.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:32:53 smithi053 bash[50091]: ts=2024-09-15T03:32:53.522Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:32:53.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:53 smithi104 bash[36607]: debug 2024-09-15T03:32:53.707+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:53.985 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:53 smithi104 bash[27846]: debug 2024-09-15T03:32:53.843+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:54.709 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:54 smithi104 bash[23755]: debug 2024-09-15T03:32:54.495+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:54.710 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:54 smithi104 bash[32268]: debug 2024-09-15T03:32:54.451+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:54.940 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:54 smithi053 bash[38868]: debug 2024-09-15T03:32:54.560+0000 7fb355480640 -1 osd.3 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.192912+0000 front 2024-09-15T03:32:25.192440+0000 (oldest deadline 2024-09-15T03:32:51.092441+0000) 2024-09-15T03:32:54.985 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:54 smithi104 bash[27846]: debug 2024-09-15T03:32:54.815+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:54.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:54 smithi104 bash[36607]: debug 2024-09-15T03:32:54.703+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:55.704 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:55 smithi104 bash[32268]: debug 2024-09-15T03:32:55.459+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:55.704 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:55 smithi104 bash[23755]: debug 2024-09-15T03:32:55.459+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:55.985 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:55 smithi104 bash[27846]: debug 2024-09-15T03:32:55.775+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:55.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:55 smithi104 bash[36607]: debug 2024-09-15T03:32:55.695+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:56.190 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:56 smithi053 bash[62082]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-3 2024-09-15T03:32:56.422 INFO:journalctl@ceph.osd.3.smithi053.stdout:Sep 15 03:32:56 smithi053 bash[62768]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-3 2024-09-15T03:32:56.771 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:56 smithi104 bash[23755]: debug 2024-09-15T03:32:56.487+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:56.771 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:56 smithi104 bash[32268]: debug 2024-09-15T03:32:56.499+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:56.772 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:56 smithi104 bash[36607]: debug 2024-09-15T03:32:56.679+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:57.235 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:56 smithi104 bash[27846]: debug 2024-09-15T03:32:56.771+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:57.735 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:57 smithi104 bash[23755]: debug 2024-09-15T03:32:57.479+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:57.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:57 smithi104 bash[36607]: debug 2024-09-15T03:32:57.667+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:57.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:57 smithi104 bash[32268]: debug 2024-09-15T03:32:57.451+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:57.985 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:57 smithi104 bash[27846]: debug 2024-09-15T03:32:57.735+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:58.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T03:32:58.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:32:58.281 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T03:32:58.281 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T03:32:58.282 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.4 2024-09-15T03:32:58.721 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:58 smithi104 bash[32268]: debug 2024-09-15T03:32:58.483+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:58.721 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:58 smithi104 systemd[1]: Stopping Ceph osd.4 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:32:58.722 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:58 smithi104 bash[23755]: debug 2024-09-15T03:32:58.507+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:58.722 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:58 smithi104 bash[23755]: debug 2024-09-15T03:32:58.519+0000 7f01de4fc640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:32:58.722 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:58 smithi104 bash[23755]: debug 2024-09-15T03:32:58.519+0000 7f01de4fc640 -1 osd.4 74 *** Got signal Terminated *** 2024-09-15T03:32:58.722 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:58 smithi104 bash[23755]: debug 2024-09-15T03:32:58.519+0000 7f01de4fc640 -1 osd.4 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:32:58.986 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:58 smithi104 bash[27846]: debug 2024-09-15T03:32:58.719+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:58.986 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:58 smithi104 bash[36607]: debug 2024-09-15T03:32:58.715+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:59.735 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:32:59 smithi104 bash[23755]: debug 2024-09-15T03:32:59.527+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:32:59.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:32:59 smithi104 bash[36607]: debug 2024-09-15T03:32:59.683+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:32:59.736 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:59 smithi104 bash[27846]: debug 2024-09-15T03:32:59.703+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:32:59.736 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:32:59 smithi104 bash[27846]: debug 2024-09-15T03:32:59.703+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:32:59.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:59 smithi104 bash[32268]: debug 2024-09-15T03:32:59.455+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:32:59.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:32:59 smithi104 bash[32268]: debug 2024-09-15T03:32:59.455+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:00.644 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:33:00 smithi104 bash[23755]: debug 2024-09-15T03:33:00.491+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:33:00.644 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:00 smithi104 bash[32268]: debug 2024-09-15T03:33:00.407+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:00.644 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:00 smithi104 bash[32268]: debug 2024-09-15T03:33:00.407+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:00.731 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:00 smithi104 bash[36607]: debug 2024-09-15T03:33:00.635+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:00.731 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:00 smithi104 bash[36607]: debug 2024-09-15T03:33:00.635+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:00.985 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:00 smithi104 bash[27846]: debug 2024-09-15T03:33:00.723+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:00.985 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:00 smithi104 bash[27846]: debug 2024-09-15T03:33:00.723+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:01.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[32268]: debug 2024-09-15T03:33:01.451+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:01.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[32268]: debug 2024-09-15T03:33:01.451+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:01.736 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[23755]: debug 2024-09-15T03:33:01.499+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:33:01.736 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[23755]: debug 2024-09-15T03:33:01.503+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:36.728765+0000 front 2024-09-15T03:32:36.728590+0000 (oldest deadline 2024-09-15T03:33:00.828375+0000) 2024-09-15T03:33:01.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[36607]: debug 2024-09-15T03:33:01.671+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:01.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[36607]: debug 2024-09-15T03:33:01.671+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:02.235 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[27846]: debug 2024-09-15T03:33:01.731+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:02.400 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:01 smithi104 bash[27846]: debug 2024-09-15T03:33:01.731+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:02.735 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[23755]: debug 2024-09-15T03:33:02.495+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:27.927353+0000 front 2024-09-15T03:32:27.927538+0000 (oldest deadline 2024-09-15T03:32:52.027212+0000) 2024-09-15T03:33:02.735 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[23755]: debug 2024-09-15T03:33:02.495+0000 7f01d9b12640 -1 osd.4 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:36.728765+0000 front 2024-09-15T03:32:36.728590+0000 (oldest deadline 2024-09-15T03:33:00.828375+0000) 2024-09-15T03:33:02.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[36607]: debug 2024-09-15T03:33:02.711+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:02.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[36607]: debug 2024-09-15T03:33:02.711+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:02.736 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[27846]: debug 2024-09-15T03:33:02.719+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:02.736 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[27846]: debug 2024-09-15T03:33:02.719+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:02.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[32268]: debug 2024-09-15T03:33:02.475+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:02.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:02 smithi104 bash[32268]: debug 2024-09-15T03:33:02.475+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:03.735 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:03 smithi104 bash[27846]: debug 2024-09-15T03:33:03.703+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:03.736 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:03 smithi104 bash[27846]: debug 2024-09-15T03:33:03.703+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:03.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:03 smithi104 bash[32268]: debug 2024-09-15T03:33:03.455+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:03.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:03 smithi104 bash[32268]: debug 2024-09-15T03:33:03.455+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:03.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:03 smithi053 bash[50091]: ts=2024-09-15T03:33:03.521Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:03.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:03 smithi053 bash[50091]: ts=2024-09-15T03:33:03.522Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:03.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:03 smithi053 bash[50091]: ts=2024-09-15T03:33:03.523Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:04.051 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:03 smithi104 bash[36607]: debug 2024-09-15T03:33:03.727+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:04.051 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:03 smithi104 bash[36607]: debug 2024-09-15T03:33:03.727+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:04.529 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[32268]: debug 2024-09-15T03:33:04.411+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:04.529 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[32268]: debug 2024-09-15T03:33:04.411+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:04.680 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[49977]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-4 2024-09-15T03:33:04.985 INFO:journalctl@ceph.osd.4.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[50171]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-4 2024-09-15T03:33:04.986 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[36607]: debug 2024-09-15T03:33:04.727+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:04.986 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[36607]: debug 2024-09-15T03:33:04.727+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:04.986 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[27846]: debug 2024-09-15T03:33:04.671+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:04.986 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:04 smithi104 bash[27846]: debug 2024-09-15T03:33:04.671+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:05.718 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:05 smithi104 bash[27846]: debug 2024-09-15T03:33:05.623+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:05.718 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:05 smithi104 bash[27846]: debug 2024-09-15T03:33:05.623+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:05.718 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:05 smithi104 bash[32268]: debug 2024-09-15T03:33:05.379+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:05.718 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:05 smithi104 bash[32268]: debug 2024-09-15T03:33:05.379+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:05.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:05 smithi104 bash[36607]: debug 2024-09-15T03:33:05.711+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:05.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:05 smithi104 bash[36607]: debug 2024-09-15T03:33:05.711+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:06.665 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:06 smithi104 bash[32268]: debug 2024-09-15T03:33:06.407+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:06.665 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:06 smithi104 bash[32268]: debug 2024-09-15T03:33:06.407+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:06.864 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T03:33:06.893 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:33:06.893 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T03:33:06.893 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T03:33:06.893 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.5 2024-09-15T03:33:06.948 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:06 smithi104 bash[27846]: debug 2024-09-15T03:33:06.659+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:06.949 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:06 smithi104 bash[27846]: debug 2024-09-15T03:33:06.659+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:06.949 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:06 smithi104 bash[36607]: debug 2024-09-15T03:33:06.699+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:06.949 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:06 smithi104 bash[36607]: debug 2024-09-15T03:33:06.699+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:07.237 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:06 smithi104 systemd[1]: Stopping Ceph osd.5 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:33:07.237 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[27846]: debug 2024-09-15T03:33:07.111+0000 7f3131885640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:33:07.237 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[27846]: debug 2024-09-15T03:33:07.111+0000 7f3131885640 -1 osd.5 74 *** Got signal Terminated *** 2024-09-15T03:33:07.237 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[27846]: debug 2024-09-15T03:33:07.111+0000 7f3131885640 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:33:07.735 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[27846]: debug 2024-09-15T03:33:07.691+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:07.735 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[27846]: debug 2024-09-15T03:33:07.691+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:07.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[32268]: debug 2024-09-15T03:33:07.447+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:07.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[32268]: debug 2024-09-15T03:33:07.447+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:08.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[36607]: debug 2024-09-15T03:33:07.747+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:08.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:07 smithi104 bash[36607]: debug 2024-09-15T03:33:07.747+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:08.735 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:08 smithi104 bash[27846]: debug 2024-09-15T03:33:08.647+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:08.735 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:08 smithi104 bash[27846]: debug 2024-09-15T03:33:08.647+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:08.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:08 smithi104 bash[32268]: debug 2024-09-15T03:33:08.435+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:08.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:08 smithi104 bash[32268]: debug 2024-09-15T03:33:08.435+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:09.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:08 smithi104 bash[36607]: debug 2024-09-15T03:33:08.731+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:09.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:08 smithi104 bash[36607]: debug 2024-09-15T03:33:08.731+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:09.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:08 smithi104 bash[36607]: debug 2024-09-15T03:33:08.731+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:09.735 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:09 smithi104 bash[27846]: debug 2024-09-15T03:33:09.623+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:09.735 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:09 smithi104 bash[27846]: debug 2024-09-15T03:33:09.623+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:09.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:09 smithi104 bash[32268]: debug 2024-09-15T03:33:09.395+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:09.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:09 smithi104 bash[32268]: debug 2024-09-15T03:33:09.395+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:10.224 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:09 smithi104 bash[36607]: debug 2024-09-15T03:33:09.763+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:10.224 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:09 smithi104 bash[36607]: debug 2024-09-15T03:33:09.763+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:10.224 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:09 smithi104 bash[36607]: debug 2024-09-15T03:33:09.763+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:10.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[32268]: debug 2024-09-15T03:33:10.439+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:10.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[32268]: debug 2024-09-15T03:33:10.439+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:10.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[32268]: debug 2024-09-15T03:33:10.439+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:10.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[36607]: debug 2024-09-15T03:33:10.759+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:10.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[36607]: debug 2024-09-15T03:33:10.759+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:10.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[36607]: debug 2024-09-15T03:33:10.759+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:10.986 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[27846]: debug 2024-09-15T03:33:10.583+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:10.986 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[27846]: debug 2024-09-15T03:33:10.583+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:10.986 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:10 smithi104 bash[27846]: debug 2024-09-15T03:33:10.583+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.049374+0000 front 2024-09-15T03:32:44.049349+0000 (oldest deadline 2024-09-15T03:33:09.949017+0000) 2024-09-15T03:33:11.729 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[27846]: debug 2024-09-15T03:33:11.543+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.046270+0000 front 2024-09-15T03:32:26.046373+0000 (oldest deadline 2024-09-15T03:32:49.446298+0000) 2024-09-15T03:33:11.729 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[27846]: debug 2024-09-15T03:33:11.543+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:34.747918+0000 front 2024-09-15T03:32:34.747968+0000 (oldest deadline 2024-09-15T03:32:58.847447+0000) 2024-09-15T03:33:11.729 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[27846]: debug 2024-09-15T03:33:11.543+0000 7f312f6a0640 -1 osd.5 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.049374+0000 front 2024-09-15T03:32:44.049349+0000 (oldest deadline 2024-09-15T03:33:09.949017+0000) 2024-09-15T03:33:11.730 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[32268]: debug 2024-09-15T03:33:11.415+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:11.730 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[32268]: debug 2024-09-15T03:33:11.415+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:11.730 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[32268]: debug 2024-09-15T03:33:11.415+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:11.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[36607]: debug 2024-09-15T03:33:11.723+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:11.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[36607]: debug 2024-09-15T03:33:11.723+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:11.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:11 smithi104 bash[36607]: debug 2024-09-15T03:33:11.723+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:12.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:12 smithi104 bash[36607]: debug 2024-09-15T03:33:12.679+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:12.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:12 smithi104 bash[36607]: debug 2024-09-15T03:33:12.679+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:12.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:12 smithi104 bash[36607]: debug 2024-09-15T03:33:12.679+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:12.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:12 smithi104 bash[32268]: debug 2024-09-15T03:33:12.435+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:12.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:12 smithi104 bash[32268]: debug 2024-09-15T03:33:12.435+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:12.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:12 smithi104 bash[32268]: debug 2024-09-15T03:33:12.435+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:13.409 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[50311]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-5 2024-09-15T03:33:13.409 INFO:journalctl@ceph.osd.5.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[50500]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-5 2024-09-15T03:33:13.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[32268]: debug 2024-09-15T03:33:13.403+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:13.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[32268]: debug 2024-09-15T03:33:13.403+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:13.735 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[32268]: debug 2024-09-15T03:33:13.403+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:13.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[36607]: debug 2024-09-15T03:33:13.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:13.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[36607]: debug 2024-09-15T03:33:13.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:13.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:13 smithi104 bash[36607]: debug 2024-09-15T03:33:13.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:13.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:13 smithi053 bash[50091]: ts=2024-09-15T03:33:13.522Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:13.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:13 smithi053 bash[50091]: ts=2024-09-15T03:33:13.523Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:13.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:13 smithi053 bash[50091]: ts=2024-09-15T03:33:13.524Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:14.645 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:14 smithi104 bash[32268]: debug 2024-09-15T03:33:14.383+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:14.646 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:14 smithi104 bash[32268]: debug 2024-09-15T03:33:14.383+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:14.646 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:14 smithi104 bash[32268]: debug 2024-09-15T03:33:14.383+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:14.925 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:14 smithi104 bash[36607]: debug 2024-09-15T03:33:14.639+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:14.925 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:14 smithi104 bash[36607]: debug 2024-09-15T03:33:14.639+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:14.926 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:14 smithi104 bash[36607]: debug 2024-09-15T03:33:14.639+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:15.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[32268]: debug 2024-09-15T03:33:15.351+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:15.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[32268]: debug 2024-09-15T03:33:15.351+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:15.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[32268]: debug 2024-09-15T03:33:15.351+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:15.612 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T03:33:15.683 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:33:15.683 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T03:33:15.684 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T03:33:15.684 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.6 2024-09-15T03:33:15.878 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[36607]: debug 2024-09-15T03:33:15.639+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:15.878 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[36607]: debug 2024-09-15T03:33:15.639+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:15.878 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[36607]: debug 2024-09-15T03:33:15.639+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:15.878 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:15 smithi104 systemd[1]: Stopping Ceph osd.6 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:33:16.235 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[32268]: debug 2024-09-15T03:33:15.871+0000 7fcf99414640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:33:16.235 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[32268]: debug 2024-09-15T03:33:15.871+0000 7fcf99414640 -1 osd.6 74 *** Got signal Terminated *** 2024-09-15T03:33:16.235 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:15 smithi104 bash[32268]: debug 2024-09-15T03:33:15.871+0000 7fcf99414640 -1 osd.6 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:33:16.621 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:16 smithi104 bash[32268]: debug 2024-09-15T03:33:16.395+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:16.621 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:16 smithi104 bash[32268]: debug 2024-09-15T03:33:16.395+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:16.621 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:16 smithi104 bash[32268]: debug 2024-09-15T03:33:16.395+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:16.622 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:16 smithi104 bash[32268]: debug 2024-09-15T03:33:16.395+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:53.016994+0000 front 2024-09-15T03:32:53.017077+0000 (oldest deadline 2024-09-15T03:33:15.916941+0000) 2024-09-15T03:33:16.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:16 smithi104 bash[36607]: debug 2024-09-15T03:33:16.615+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:16.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:16 smithi104 bash[36607]: debug 2024-09-15T03:33:16.615+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:16.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:16 smithi104 bash[36607]: debug 2024-09-15T03:33:16.615+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:17.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:17 smithi104 bash[36607]: debug 2024-09-15T03:33:17.619+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:17.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:17 smithi104 bash[36607]: debug 2024-09-15T03:33:17.619+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:17.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:17 smithi104 bash[36607]: debug 2024-09-15T03:33:17.619+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:17.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:17 smithi104 bash[32268]: debug 2024-09-15T03:33:17.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:17.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:17 smithi104 bash[32268]: debug 2024-09-15T03:33:17.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:17.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:17 smithi104 bash[32268]: debug 2024-09-15T03:33:17.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:17.736 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:17 smithi104 bash[32268]: debug 2024-09-15T03:33:17.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:53.016994+0000 front 2024-09-15T03:32:53.017077+0000 (oldest deadline 2024-09-15T03:33:15.916941+0000) 2024-09-15T03:33:18.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[32268]: debug 2024-09-15T03:33:18.327+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:18.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[32268]: debug 2024-09-15T03:33:18.327+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:18.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[32268]: debug 2024-09-15T03:33:18.327+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:18.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[32268]: debug 2024-09-15T03:33:18.327+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:53.016994+0000 front 2024-09-15T03:32:53.017077+0000 (oldest deadline 2024-09-15T03:33:15.916941+0000) 2024-09-15T03:33:18.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[36607]: debug 2024-09-15T03:33:18.611+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:18.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[36607]: debug 2024-09-15T03:33:18.611+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:18.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[36607]: debug 2024-09-15T03:33:18.611+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:18.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:18 smithi104 bash[36607]: debug 2024-09-15T03:33:18.611+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:19.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[32268]: debug 2024-09-15T03:33:19.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:19.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[32268]: debug 2024-09-15T03:33:19.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:19.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[32268]: debug 2024-09-15T03:33:19.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:19.485 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[32268]: debug 2024-09-15T03:33:19.375+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:53.016994+0000 front 2024-09-15T03:32:53.017077+0000 (oldest deadline 2024-09-15T03:33:15.916941+0000) 2024-09-15T03:33:19.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[36607]: debug 2024-09-15T03:33:19.595+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:19.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[36607]: debug 2024-09-15T03:33:19.595+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:19.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[36607]: debug 2024-09-15T03:33:19.595+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:19.986 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:19 smithi104 bash[36607]: debug 2024-09-15T03:33:19.595+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:20.636 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[32268]: debug 2024-09-15T03:33:20.371+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:25.413606+0000 front 2024-09-15T03:32:25.413656+0000 (oldest deadline 2024-09-15T03:32:51.313318+0000) 2024-09-15T03:33:20.636 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[32268]: debug 2024-09-15T03:33:20.371+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.614759+0000 front 2024-09-15T03:32:33.614779+0000 (oldest deadline 2024-09-15T03:32:58.914552+0000) 2024-09-15T03:33:20.636 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[32268]: debug 2024-09-15T03:33:20.371+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:44.215963+0000 front 2024-09-15T03:32:44.216206+0000 (oldest deadline 2024-09-15T03:33:09.515761+0000) 2024-09-15T03:33:20.636 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[32268]: debug 2024-09-15T03:33:20.371+0000 7fcf9722f640 -1 osd.6 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:53.016994+0000 front 2024-09-15T03:32:53.017077+0000 (oldest deadline 2024-09-15T03:33:15.916941+0000) 2024-09-15T03:33:20.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[36607]: debug 2024-09-15T03:33:20.627+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:20.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[36607]: debug 2024-09-15T03:33:20.627+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:20.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[36607]: debug 2024-09-15T03:33:20.627+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:20.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:20 smithi104 bash[36607]: debug 2024-09-15T03:33:20.627+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:21.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:21 smithi104 bash[36607]: debug 2024-09-15T03:33:21.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:21.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:21 smithi104 bash[36607]: debug 2024-09-15T03:33:21.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:21.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:21 smithi104 bash[36607]: debug 2024-09-15T03:33:21.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:21.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:21 smithi104 bash[36607]: debug 2024-09-15T03:33:21.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:22.235 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:21 smithi104 bash[50990]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-6 2024-09-15T03:33:22.235 INFO:journalctl@ceph.osd.6.smithi104.stdout:Sep 15 03:33:22 smithi104 bash[51401]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-6 2024-09-15T03:33:22.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:22 smithi104 bash[36607]: debug 2024-09-15T03:33:22.683+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:22.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:22 smithi104 bash[36607]: debug 2024-09-15T03:33:22.683+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:22.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:22 smithi104 bash[36607]: debug 2024-09-15T03:33:22.683+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:22.985 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:22 smithi104 bash[36607]: debug 2024-09-15T03:33:22.683+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:23.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:23 smithi053 bash[50091]: ts=2024-09-15T03:33:23.522Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:23.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:23 smithi053 bash[50091]: ts=2024-09-15T03:33:23.523Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:23.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:23 smithi053 bash[50091]: ts=2024-09-15T03:33:23.525Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:23.948 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:23 smithi104 bash[36607]: debug 2024-09-15T03:33:23.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:23.948 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:23 smithi104 bash[36607]: debug 2024-09-15T03:33:23.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:23.948 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:23 smithi104 bash[36607]: debug 2024-09-15T03:33:23.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:23.948 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:23 smithi104 bash[36607]: debug 2024-09-15T03:33:23.647+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:24.470 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T03:33:24.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:33:24.501 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T03:33:24.502 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T03:33:24.502 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.7 2024-09-15T03:33:24.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 systemd[1]: Stopping Ceph osd.7 for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:33:24.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 bash[36607]: debug 2024-09-15T03:33:24.687+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:24.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 bash[36607]: debug 2024-09-15T03:33:24.687+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:24.735 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 bash[36607]: debug 2024-09-15T03:33:24.687+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:24.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 bash[36607]: debug 2024-09-15T03:33:24.687+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:24.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 bash[36607]: debug 2024-09-15T03:33:24.711+0000 7f8e9d2ba640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:33:24.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 bash[36607]: debug 2024-09-15T03:33:24.711+0000 7f8e9d2ba640 -1 osd.7 74 *** Got signal Terminated *** 2024-09-15T03:33:24.736 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:24 smithi104 bash[36607]: debug 2024-09-15T03:33:24.711+0000 7f8e9d2ba640 -1 osd.7 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T03:33:26.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:25 smithi104 bash[36607]: debug 2024-09-15T03:33:25.731+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:26.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:25 smithi104 bash[36607]: debug 2024-09-15T03:33:25.731+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:26.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:25 smithi104 bash[36607]: debug 2024-09-15T03:33:25.731+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:26.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:25 smithi104 bash[36607]: debug 2024-09-15T03:33:25.731+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:27.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:26 smithi104 bash[36607]: debug 2024-09-15T03:33:26.763+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:27.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:26 smithi104 bash[36607]: debug 2024-09-15T03:33:26.763+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:27.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:26 smithi104 bash[36607]: debug 2024-09-15T03:33:26.763+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:27.236 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:26 smithi104 bash[36607]: debug 2024-09-15T03:33:26.763+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:28.237 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:27 smithi104 bash[36607]: debug 2024-09-15T03:33:27.791+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:28.237 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:27 smithi104 bash[36607]: debug 2024-09-15T03:33:27.791+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:28.237 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:27 smithi104 bash[36607]: debug 2024-09-15T03:33:27.791+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:28.237 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:27 smithi104 bash[36607]: debug 2024-09-15T03:33:27.791+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:29.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:28 smithi104 bash[36607]: debug 2024-09-15T03:33:28.783+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6806 osd.0 since back 2024-09-15T03:32:26.304547+0000 front 2024-09-15T03:32:26.304978+0000 (oldest deadline 2024-09-15T03:32:52.204638+0000) 2024-09-15T03:33:29.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:28 smithi104 bash[36607]: debug 2024-09-15T03:33:28.783+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6814 osd.1 since back 2024-09-15T03:32:33.905921+0000 front 2024-09-15T03:32:33.906169+0000 (oldest deadline 2024-09-15T03:32:59.805750+0000) 2024-09-15T03:33:29.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:28 smithi104 bash[36607]: debug 2024-09-15T03:33:28.783+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6822 osd.2 since back 2024-09-15T03:32:43.307348+0000 front 2024-09-15T03:32:43.307496+0000 (oldest deadline 2024-09-15T03:33:08.607005+0000) 2024-09-15T03:33:29.235 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:28 smithi104 bash[36607]: debug 2024-09-15T03:33:28.783+0000 7f8e980cf640 -1 osd.7 74 heartbeat_check: no reply from 172.21.15.53:6830 osd.3 since back 2024-09-15T03:32:52.009222+0000 front 2024-09-15T03:32:52.009177+0000 (oldest deadline 2024-09-15T03:33:17.908858+0000) 2024-09-15T03:33:30.964 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:30 smithi104 bash[51540]: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-7 2024-09-15T03:33:30.964 INFO:journalctl@ceph.osd.7.smithi104.stdout:Sep 15 03:33:30 smithi104 bash[51629]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-osd-7 2024-09-15T03:33:32.957 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T03:33:32.985 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:33:32.985 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T03:33:32.986 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-09-15T03:33:32.986 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@rgw.foo.a 2024-09-15T03:33:33.441 INFO:journalctl@ceph.rgw.foo.a.smithi053.stdout:Sep 15 03:33:33 smithi053 systemd[1]: Stopping Ceph rgw.foo.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:33:33.441 INFO:journalctl@ceph.rgw.foo.a.smithi053.stdout:Sep 15 03:33:33 smithi053 bash[44886]: debug 2024-09-15T03:33:33.155+0000 7f34737fe640 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-09-15T03:33:33.441 INFO:journalctl@ceph.rgw.foo.a.smithi053.stdout:Sep 15 03:33:33 smithi053 bash[44886]: debug 2024-09-15T03:33:33.155+0000 7f347b6307c0 -1 shutting down 2024-09-15T03:33:33.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:33 smithi053 bash[50091]: ts=2024-09-15T03:33:33.523Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:33.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:33 smithi053 bash[50091]: ts=2024-09-15T03:33:33.524Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:33.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:33 smithi053 bash[50091]: ts=2024-09-15T03:33:33.525Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:41.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:41 smithi053 bash[50091]: ts=2024-09-15T03:33:41.629Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:41.941 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:41 smithi053 bash[50091]: ts=2024-09-15T03:33:41.630Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:43.765 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:43 smithi053 bash[50091]: ts=2024-09-15T03:33:43.524Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=2 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:43.765 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:43 smithi053 bash[50091]: ts=2024-09-15T03:33:43.525Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:43.765 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:43 smithi053 bash[50091]: ts=2024-09-15T03:33:43.526Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:43.982 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@rgw.foo.a.service' 2024-09-15T03:33:44.013 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:33:44.013 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-09-15T03:33:44.014 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-15T03:33:44.014 DEBUG:teuthology.orchestra.run.smithi104:> sudo systemctl stop ceph-aed93852-7310-11ef-bceb-c7b262605968@prometheus.a 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 systemd[1]: Stopping Ceph prometheus.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.192Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.192Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.192Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.192Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.192Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.193Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.193Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-15T03:33:44.394 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.193Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-15T03:33:44.395 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.193Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-15T03:33:44.395 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.194Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-15T03:33:44.395 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.194Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-15T03:33:44.395 INFO:journalctl@ceph.prometheus.a.smithi104.stdout:Sep 15 03:33:44 smithi104 bash[44126]: ts=2024-09-15T03:33:44.194Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-15T03:33:44.871 DEBUG:teuthology.orchestra.run.smithi104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-aed93852-7310-11ef-bceb-c7b262605968@prometheus.a.service' 2024-09-15T03:33:44.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T03:33:44.899 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-15T03:33:44.899 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aed93852-7310-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T03:33:51.734 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:51 smithi053 bash[50091]: ts=2024-09-15T03:33:51.628Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:51.734 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:51 smithi053 bash[50091]: ts=2024-09-15T03:33:51.629Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi053.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.53:8443: connect: connection refused" 2024-09-15T03:33:51.734 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:51 smithi053 bash[50091]: ts=2024-09-15T03:33:51.630Z caller=notify.go:732 level=warn component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi104.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.104:8443: connect: connection refused" 2024-09-15T03:33:52.169 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:33:51 smithi053 systemd[1]: Stopping Ceph node-exporter.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:33:52.941 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:33:52 smithi053 bash[64573]: ceph-aed93852-7310-11ef-bceb-c7b262605968-node-exporter-a 2024-09-15T03:33:52.941 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:33:52 smithi053 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-15T03:33:52.941 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:33:52 smithi053 bash[64634]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-node-exporter-a 2024-09-15T03:33:52.941 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:33:52 smithi053 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-15T03:33:52.941 INFO:journalctl@ceph.node-exporter.a.smithi053.stdout:Sep 15 03:33:52 smithi053 systemd[1]: Stopped Ceph node-exporter.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:33:53.388 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:53 smithi053 systemd[1]: Stopping Ceph alertmanager.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:33:53.388 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:53 smithi053 bash[50091]: ts=2024-09-15T03:33:53.177Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-15T03:33:53.690 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:53 smithi053 bash[64695]: ceph-aed93852-7310-11ef-bceb-c7b262605968-alertmanager-a 2024-09-15T03:33:54.081 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:53 smithi053 bash[64759]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-alertmanager-a 2024-09-15T03:33:54.081 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:53 smithi053 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@alertmanager.a.service: Succeeded. 2024-09-15T03:33:54.081 INFO:journalctl@ceph.alertmanager.a.smithi053.stdout:Sep 15 03:33:53 smithi053 systemd[1]: Stopped Ceph alertmanager.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:33:54.604 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aed93852-7310-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T03:34:00.441 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:00 smithi104 systemd[1]: Stopping Ceph iscsi.iscsi.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:34:00.735 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:00 smithi104 bash[39933]: debug Shutdown received 2024-09-15T03:34:11.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:11 smithi104 bash[53099]: ceph-aed93852-7310-11ef-bceb-c7b262605968-iscsi-iscsi-a 2024-09-15T03:34:11.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:11 smithi104 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-09-15T03:34:11.485 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:11 smithi104 bash[53198]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-iscsi-iscsi-a 2024-09-15T03:34:12.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:11 smithi104 bash[53208]: ceph-aed93852-7310-11ef-bceb-c7b262605968-iscsi-iscsi-a-tcmu 2024-09-15T03:34:12.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:11 smithi104 bash[53245]: rm: cannot remove '/run/ceph-aed93852-7310-11ef-bceb-c7b262605968@iscsi.iscsi.a.tcmu.service-pid': No such file or directory 2024-09-15T03:34:12.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:11 smithi104 bash[53246]: rm: cannot remove '/run/ceph-aed93852-7310-11ef-bceb-c7b262605968@iscsi.iscsi.a.tcmu.service-cid': No such file or directory 2024-09-15T03:34:12.235 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:12 smithi104 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-09-15T03:34:12.236 INFO:journalctl@ceph.iscsi.iscsi.a.smithi104.stdout:Sep 15 03:34:12 smithi104 systemd[1]: Stopped Ceph iscsi.iscsi.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:34:12.686 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:34:12 smithi104 systemd[1]: Stopping Ceph node-exporter.b for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:34:13.485 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:34:13 smithi104 bash[53325]: ceph-aed93852-7310-11ef-bceb-c7b262605968-node-exporter-b 2024-09-15T03:34:13.485 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:34:13 smithi104 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-15T03:34:13.485 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:34:13 smithi104 bash[53388]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-node-exporter-b 2024-09-15T03:34:13.485 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:34:13 smithi104 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-15T03:34:13.485 INFO:journalctl@ceph.node-exporter.b.smithi104.stdout:Sep 15 03:34:13 smithi104 systemd[1]: Stopped Ceph node-exporter.b for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:34:13.970 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:34:13 smithi104 systemd[1]: Stopping Ceph grafana.a for aed93852-7310-11ef-bceb-c7b262605968... 2024-09-15T03:34:14.685 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:34:14 smithi104 bash[53448]: ceph-aed93852-7310-11ef-bceb-c7b262605968-grafana-a 2024-09-15T03:34:14.685 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:34:14 smithi104 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-09-15T03:34:14.685 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:34:14 smithi104 bash[53511]: Error response from daemon: No such container: ceph-aed93852-7310-11ef-bceb-c7b262605968-grafana-a 2024-09-15T03:34:14.685 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:34:14 smithi104 systemd[1]: ceph-aed93852-7310-11ef-bceb-c7b262605968@grafana.a.service: Failed with result 'exit-code'. 2024-09-15T03:34:14.685 INFO:journalctl@ceph.grafana.a.smithi104.stdout:Sep 15 03:34:14 smithi104 systemd[1]: Stopped Ceph grafana.a for aed93852-7310-11ef-bceb-c7b262605968. 2024-09-15T03:34:15.195 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T03:34:15.213 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T03:34:15.228 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T03:34:15.230 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248/remote/smithi053/crash 2024-09-15T03:34:15.231 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/crash -- . 2024-09-15T03:34:15.273 INFO:teuthology.orchestra.run.smithi053.stderr:tar: /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T03:34:15.273 INFO:teuthology.orchestra.run.smithi053.stderr:tar: Error is not recoverable: exiting now 2024-09-15T03:34:15.276 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248/remote/smithi104/crash 2024-09-15T03:34:15.277 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/crash -- . 2024-09-15T03:34:15.290 INFO:teuthology.orchestra.run.smithi104.stderr:tar: /var/lib/ceph/aed93852-7310-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T03:34:15.292 INFO:teuthology.orchestra.run.smithi104.stderr:tar: Error is not recoverable: exiting now 2024-09-15T03:34:15.294 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T03:34:15.294 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v MON_DOWN | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-09-15T03:34:15.333 INFO:teuthology.orchestra.run.smithi053.stderr:grep: /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-15T03:34:15.335 INFO:tasks.cephadm:Compressing logs... 2024-09-15T03:34:15.336 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T03:34:15.380 DEBUG:teuthology.orchestra.run.smithi104:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T03:34:15.393 INFO:teuthology.orchestra.run.smithi053.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-15T03:34:15.396 INFO:teuthology.orchestra.run.smithi104.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-09-15T03:34:15.404 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T03:34:15.409 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-client.rgw.foo.a.log 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-client.rgw.foo.a.log: /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr: 58.1% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-client.rgw.foo.a.log.gz 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T03:34:15.410 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T03:34:15.411 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T03:34:15.412 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T03:34:15.412 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T03:34:15.412 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T03:34:15.412 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T03:34:15.412 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.5.log: /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/tcmu-runner.log 2024-09-15T03:34:15.412 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T03:34:15.413 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T03:34:15.413 INFO:teuthology.orchestra.run.smithi104.stderr: 62.9% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/tcmu-runner.log.gz 2024-09-15T03:34:15.413 INFO:teuthology.orchestra.run.smithi104.stderr:gzip -5 --verbose -- /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T03:34:15.414 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T03:34:15.419 INFO:teuthology.orchestra.run.smithi104.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.7.log: /var/log/ceph/cephadm.log: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T03:34:15.420 INFO:teuthology.orchestra.run.smithi104.stderr: 91.5% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T03:34:15.436 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.2.log: /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T03:34:15.497 INFO:teuthology.orchestra.run.smithi104.stderr: 90.2% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T03:34:15.510 INFO:teuthology.orchestra.run.smithi053.stderr: 90.0% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T03:34:15.592 INFO:teuthology.orchestra.run.smithi053.stderr: 92.9% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T03:34:15.653 INFO:teuthology.orchestra.run.smithi053.stderr: 87.8% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T03:34:15.671 INFO:teuthology.orchestra.run.smithi104.stderr: 92.6% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T03:34:15.677 INFO:teuthology.orchestra.run.smithi104.stderr: 93.0% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T03:34:15.697 INFO:teuthology.orchestra.run.smithi053.stderr: 92.9% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T03:34:15.800 INFO:teuthology.orchestra.run.smithi104.stderr: 93.1% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T03:34:15.802 INFO:teuthology.orchestra.run.smithi104.stderr: 93.5% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T03:34:15.810 INFO:teuthology.orchestra.run.smithi104.stderr: 93.3% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T03:34:15.812 INFO:teuthology.orchestra.run.smithi104.stderr: 2024-09-15T03:34:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:real 0m0.424s 2024-09-15T03:34:15.812 INFO:teuthology.orchestra.run.smithi104.stderr:user 0m1.766s 2024-09-15T03:34:15.813 INFO:teuthology.orchestra.run.smithi104.stderr:sys 0m0.061s 2024-09-15T03:34:15.833 INFO:teuthology.orchestra.run.smithi053.stderr: 93.3% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T03:34:15.879 INFO:teuthology.orchestra.run.smithi053.stderr: 93.3% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T03:34:15.939 INFO:teuthology.orchestra.run.smithi053.stderr: 93.2% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T03:34:16.088 INFO:teuthology.orchestra.run.smithi053.stderr: 91.3% -- replaced with /var/log/ceph/aed93852-7310-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T03:34:16.090 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-09-15T03:34:16.090 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m0.707s 2024-09-15T03:34:16.090 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m2.832s 2024-09-15T03:34:16.090 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.129s 2024-09-15T03:34:16.090 INFO:tasks.cephadm:Archiving logs... 2024-09-15T03:34:16.091 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248/remote/smithi053/log 2024-09-15T03:34:16.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T03:34:16.493 DEBUG:teuthology.misc:Transferring archived files from smithi104:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248/remote/smithi104/log 2024-09-15T03:34:16.494 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T03:34:16.709 INFO:tasks.cephadm:Removing cluster... 2024-09-15T03:34:16.709 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aed93852-7310-11ef-bceb-c7b262605968 --force 2024-09-15T03:34:18.077 DEBUG:teuthology.orchestra.run.smithi104:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid aed93852-7310-11ef-bceb-c7b262605968 --force 2024-09-15T03:34:19.427 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T03:34:19.428 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T03:34:19.435 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T03:34:19.443 INFO:tasks.cephadm:Teardown complete 2024-09-15T03:34:19.443 DEBUG:teuthology.run_tasks:Unwinding manager nvme_loop 2024-09-15T03:34:19.453 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi053:/dev/vg_nvme/lv_1... 2024-09-15T03:34:19.454 DEBUG:teuthology.orchestra.run.smithi053:> sudo nvme disconnect -n lv_1 2024-09-15T03:34:19.762 INFO:teuthology.orchestra.run.smithi053.stdout:NQN:lv_1 disconnected 1 controller(s) 2024-09-15T03:34:19.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:19.763 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi053:/dev/vg_nvme/lv_2... 2024-09-15T03:34:19.763 DEBUG:teuthology.orchestra.run.smithi053:> sudo nvme disconnect -n lv_2 2024-09-15T03:34:20.074 INFO:teuthology.orchestra.run.smithi053.stdout:NQN:lv_2 disconnected 1 controller(s) 2024-09-15T03:34:20.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:20.076 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi053:/dev/vg_nvme/lv_3... 2024-09-15T03:34:20.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo nvme disconnect -n lv_3 2024-09-15T03:34:20.442 INFO:teuthology.orchestra.run.smithi053.stdout:NQN:lv_3 disconnected 1 controller(s) 2024-09-15T03:34:20.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:20.444 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi053:/dev/vg_nvme/lv_4... 2024-09-15T03:34:20.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo nvme disconnect -n lv_4 2024-09-15T03:34:20.770 INFO:teuthology.orchestra.run.smithi053.stdout:NQN:lv_4 disconnected 1 controller(s) 2024-09-15T03:34:20.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:20.772 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-09-15T03:34:20.772 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/scratch_devs 2024-09-15T03:34:20.787 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi104:/dev/vg_nvme/lv_1... 2024-09-15T03:34:20.787 DEBUG:teuthology.orchestra.run.smithi104:> sudo nvme disconnect -n lv_1 2024-09-15T03:34:21.084 INFO:teuthology.orchestra.run.smithi104.stdout:NQN:lv_1 disconnected 1 controller(s) 2024-09-15T03:34:21.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:21.086 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi104:/dev/vg_nvme/lv_2... 2024-09-15T03:34:21.086 DEBUG:teuthology.orchestra.run.smithi104:> sudo nvme disconnect -n lv_2 2024-09-15T03:34:21.364 INFO:teuthology.orchestra.run.smithi104.stdout:NQN:lv_2 disconnected 1 controller(s) 2024-09-15T03:34:21.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:21.366 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi104:/dev/vg_nvme/lv_3... 2024-09-15T03:34:21.366 DEBUG:teuthology.orchestra.run.smithi104:> sudo nvme disconnect -n lv_3 2024-09-15T03:34:21.688 INFO:teuthology.orchestra.run.smithi104.stdout:NQN:lv_3 disconnected 1 controller(s) 2024-09-15T03:34:21.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:21.690 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi104:/dev/vg_nvme/lv_4... 2024-09-15T03:34:21.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo nvme disconnect -n lv_4 2024-09-15T03:34:22.016 INFO:teuthology.orchestra.run.smithi104.stdout:NQN:lv_4 disconnected 1 controller(s) 2024-09-15T03:34:22.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:22.019 DEBUG:teuthology.orchestra.run.smithi104:> set -ex 2024-09-15T03:34:22.019 DEBUG:teuthology.orchestra.run.smithi104:> sudo dd of=/scratch_devs 2024-09-15T03:34:22.034 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T03:34:22.043 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T03:34:22.043 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T03:34:22.046 DEBUG:teuthology.orchestra.run.smithi104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T03:34:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T03:34:22.063 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-09-15T03:34:22.063 INFO:teuthology.orchestra.run.smithi053.stdout:*hv01.front.sepi 67.205.162.81 3 u 54 64 377 0.094 0.765 0.082 2024-09-15T03:34:22.063 INFO:teuthology.orchestra.run.smithi053.stdout:+hv02.front.sepi 63.231.80.2 3 u 46 64 377 0.092 1.097 0.070 2024-09-15T03:34:22.063 INFO:teuthology.orchestra.run.smithi053.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.088 1.024 0.078 2024-09-15T03:34:22.063 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-09-15T03:34:22.095 INFO:teuthology.orchestra.run.smithi104.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T03:34:22.096 INFO:teuthology.orchestra.run.smithi104.stdout:============================================================================== 2024-09-15T03:34:22.096 INFO:teuthology.orchestra.run.smithi104.stdout:+hv01.front.sepi 67.205.162.81 3 u 54 64 377 0.086 3.827 1.128 2024-09-15T03:34:22.096 INFO:teuthology.orchestra.run.smithi104.stdout:*hv02.front.sepi 63.231.80.2 3 u 56 64 377 0.087 3.920 0.880 2024-09-15T03:34:22.096 INFO:teuthology.orchestra.run.smithi104.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.100 2.172 1.451 2024-09-15T03:34:22.096 INFO:teuthology.orchestra.run.smithi104.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2024-09-15T03:34:22.097 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T03:34:22.105 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T03:34:22.106 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T03:34:22.136 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T03:34:22.177 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T03:34:22.228 INFO:teuthology.task.internal:Duration was 1519.908602 seconds 2024-09-15T03:34:22.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T03:34:22.277 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T03:34:22.278 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T03:34:22.280 DEBUG:teuthology.orchestra.run.smithi104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T03:34:22.329 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T03:34:22.329 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-09-15T03:34:22.329 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T03:34:22.383 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi104.front.sepia.ceph.com 2024-09-15T03:34:22.384 DEBUG:teuthology.orchestra.run.smithi104:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T03:34:22.399 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T03:34:22.399 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T03:34:22.427 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T03:34:22.494 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T03:34:22.495 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T03:34:22.497 DEBUG:teuthology.orchestra.run.smithi104:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T03:34:22.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T03:34:22.641 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T03:34:22.641 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T03:34:22.657 DEBUG:teuthology.orchestra.run.smithi104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T03:34:22.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T03:34:22.682 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T03:34:22.703 DEBUG:teuthology.orchestra.run.smithi104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T03:34:22.715 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-09-15T03:34:22.730 INFO:teuthology.orchestra.run.smithi104.stdout:kernel.core_pattern = core 2024-09-15T03:34:22.760 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T03:34:22.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:22.792 DEBUG:teuthology.orchestra.run.smithi104:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T03:34:22.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T03:34:22.819 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T03:34:22.853 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T03:34:22.854 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248/remote/smithi053 2024-09-15T03:34:22.855 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T03:34:22.944 DEBUG:teuthology.misc:Transferring archived files from smithi104:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-15_00:54:39-rados-wip-bharath9-testing-2024-09-13-1444-quincy-distro-default-smithi/7905248/remote/smithi104 2024-09-15T03:34:22.944 DEBUG:teuthology.orchestra.run.smithi104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T03:34:23.045 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T03:34:23.046 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T03:34:23.048 DEBUG:teuthology.orchestra.run.smithi104:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T03:34:23.056 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T03:34:23.092 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T03:34:23.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T03:34:23.379 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T03:34:23.380 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T03:34:23.383 DEBUG:teuthology.orchestra.run.smithi104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T03:34:23.388 INFO:teuthology.orchestra.run.smithi053.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 03:34 /home/ubuntu/cephtest 2024-09-15T03:34:23.391 INFO:teuthology.orchestra.run.smithi104.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 03:34 /home/ubuntu/cephtest 2024-09-15T03:34:23.394 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T03:34:24.536 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T03:34:25.605 INFO:teuthology.run:Summary data: description: rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} duration: 1519.9086022377014 owner: scheduled_skanta@teuthology success: true 2024-09-15T03:34:25.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T03:34:25.695 INFO:teuthology.run:pass