2024-09-17T08:58:21.886 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T08:58:21.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T08:58:21.984 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271 branch: reef description: orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} email: ceph-qa@ceph.com first_in_suite: false job_id: '7908271' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 1 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - CEPHADM_AGENT_DOWN - CEPHADM_FAILED_DAEMON log-only-match: - CEPHADM_ sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: reef sha1: 1cbdc9211df088cccbd94423c7cf3a2b85fe432b owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - osd.0 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.1 - client.1 - prometheus.a - grafana.a - node-exporter.b - - mon.c - mgr.z - osd.2 - client.2 - node-exporter.c seed: 5234 sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 sleep_before_teardown: 0 subset: 46/64 suite: orch suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1cbdc9211df088cccbd94423c7cf3a2b85fe432b targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJAYlB2Ins0rQlXxz6SgoyUTE/cb+uqpwTPlspT95ggH1zFXjfouZblPUNBb+a4ZxKjNOHOJNi7bzARMgW9S2Q= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLd0+9oxtCQreHoTllKeTuoifokjlEFXfheC48w2oDyk84htetARDG4dnMEVrNAyJhY7guZ7JabRPRdusPS9p2E= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtNXhMYP9o1FCknOmfZzNQb8LgzoJkIjOBPT8LhrKL3zheRq+n1Dj+eNduUwnF5jsXODeon2xvNc22BIzr/mbw= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install runc nvmetcli nvme-cli -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - nvme_loop: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - cephadm.shell: mon.a: - stat -c '%u %g' /var/log/ceph | grep '167 167' - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - ceph orch ls --format yaml - ceph orch ls | grep '^osd ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_22:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T08:58:21.984 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa; will attempt to use it 2024-09-17T08:58:21.985 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1cbdc9211df088cccbd94423c7cf3a2b85fe432b/qa/tasks 2024-09-17T08:58:21.985 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T08:58:21.986 INFO:teuthology.task.internal:Checking packages... 2024-09-17T08:58:22.007 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9' 2024-09-17T08:58:22.007 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T08:58:22.007 INFO:teuthology.packaging:ref: None 2024-09-17T08:58:22.007 INFO:teuthology.packaging:tag: None 2024-09-17T08:58:22.007 INFO:teuthology.packaging:branch: reef 2024-09-17T08:58:22.007 INFO:teuthology.packaging:sha1: 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T08:58:22.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-09-17T08:58:22.266 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-855.g19e2a2be 2024-09-17T08:58:22.267 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T08:58:22.274 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T08:58:22.274 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T08:58:22.297 INFO:teuthology.task.internal:Saving configuration 2024-09-17T08:58:22.308 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T08:58:22.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T08:58:22.342 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 08:52:47.047135', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLJAYlB2Ins0rQlXxz6SgoyUTE/cb+uqpwTPlspT95ggH1zFXjfouZblPUNBb+a4ZxKjNOHOJNi7bzARMgW9S2Q='} 2024-09-17T08:58:22.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 08:52:47.050736', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLd0+9oxtCQreHoTllKeTuoifokjlEFXfheC48w2oDyk84htetARDG4dnMEVrNAyJhY7guZ7JabRPRdusPS9p2E='} 2024-09-17T08:58:22.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 08:52:47.049062', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtNXhMYP9o1FCknOmfZzNQb8LgzoJkIjOBPT8LhrKL3zheRq+n1Dj+eNduUwnF5jsXODeon2xvNc22BIzr/mbw='} 2024-09-17T08:58:22.385 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T08:58:22.393 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-09-17T08:58:22.393 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.1', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-09-17T08:58:22.393 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'osd.2', 'client.2', 'node-exporter.c'] 2024-09-17T08:58:22.393 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T08:58:22.483 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3a5e867ac0>, signals=[15]) 2024-09-17T08:58:22.483 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T08:58:22.490 INFO:teuthology.task.internal:Opening connections... 2024-09-17T08:58:22.490 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T08:58:22.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:58:22.569 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-09-17T08:58:22.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:58:22.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T08:58:22.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T08:58:22.721 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T08:58:22.727 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-09-17T08:58:22.745 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-09-17T08:58:22.746 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-09-17T08:58:22.802 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-09-17T08:58:22.802 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T08:58:22.803 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T08:58:22.804 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-09-17T08:58:22.822 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-09-17T08:58:22.840 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-09-17T08:58:22.841 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-09-17T08:58:22.898 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-09-17T08:58:22.898 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T08:58:22.899 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T08:58:22.900 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-09-17T08:58:22.922 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-09-17T08:58:22.940 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-09-17T08:58:22.940 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-09-17T08:58:22.997 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-09-17T08:58:22.997 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T08:58:22.998 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T08:58:22.999 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-09-17T08:58:23.022 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T08:58:23.031 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T08:58:23.039 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T08:58:23.039 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-09-17T08:58:23.042 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-09-17T08:58:23.044 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-09-17T08:58:23.061 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T08:58:23.069 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T08:58:23.069 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-09-17T08:58:23.099 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-09-17T08:58:23.101 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-09-17T08:58:23.155 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T08:58:23.234 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T08:58:23.254 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T08:58:23.254 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T08:58:23.254 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T08:58:23.256 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T08:58:23.256 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T08:58:23.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T08:58:23.274 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-17T08:58:23.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T08:58:23.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T08:58:23.276 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-17T08:58:23.276 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-17T08:58:23.331 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-503.el9.x86_64 2024-09-17T08:58:23.332 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-503.el9.x86_64 2024-09-17T08:58:23.332 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-09-17T08:58:23.333 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-503.el9.x86_64 2024-09-17T08:58:23.333 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.14.0-503.el9.x86_64 2024-09-17T08:58:23.333 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y kernel 2024-09-17T08:58:23.334 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-503.el9.x86_64 2024-09-17T08:58:23.334 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.14.0-503.el9.x86_64 2024-09-17T08:58:23.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2024-09-17T08:58:26.478 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.3 MB 00:01 2024-09-17T08:58:27.163 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.3 MB 00:02 2024-09-17T08:58:27.247 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.3 MB 00:02 2024-09-17T08:58:28.254 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-17T08:58:30.481 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-17T08:58:30.615 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 20 MB 00:02 2024-09-17T08:58:34.629 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-17T08:58:36.023 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-17T08:58:36.322 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-17T08:58:36.939 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-17T08:58:37.176 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-17T08:58:37.474 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 93 kB/s | 19 kB 00:00 2024-09-17T08:58:38.456 INFO:teuthology.orchestra.run.smithi179.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-17T08:58:38.612 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-17T08:58:39.261 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-17T08:58:42.673 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T08:58:44.193 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-17T08:58:44.572 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T08:58:44.572 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T08:58:44.666 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-17T08:58:44.675 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T08:58:44.686 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-17T08:58:44.687 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T08:58:44.687 INFO:teuthology.orchestra.run.smithi161.stdout:Install 4 Packages 2024-09-17T08:58:44.687 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T08:58:44.687 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 79 M 2024-09-17T08:58:44.687 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 126 M 2024-09-17T08:58:44.687 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-17T08:58:45.383 INFO:teuthology.orchestra.run.smithi161.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 62 kB/s | 36 kB 00:00 2024-09-17T08:58:46.124 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T08:58:46.124 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T08:58:46.210 INFO:teuthology.orchestra.run.smithi161.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-17T08:58:46.220 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-17T08:58:46.231 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T08:58:46.231 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-17T08:58:46.231 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T08:58:46.231 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-09-17T08:58:46.232 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T08:58:46.233 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 79 M 2024-09-17T08:58:46.233 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 126 M 2024-09-17T08:58:46.233 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-17T08:58:46.586 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 333 kB/s | 36 kB 00:00 2024-09-17T08:58:46.589 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T08:58:46.589 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T08:58:46.681 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout: Package Architecture Version Repository Size 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T08:58:46.697 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T08:58:46.698 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-17T08:58:46.698 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T08:58:46.698 INFO:teuthology.orchestra.run.smithi179.stdout:Install 4 Packages 2024-09-17T08:58:46.698 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T08:58:46.698 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 79 M 2024-09-17T08:58:46.698 INFO:teuthology.orchestra.run.smithi179.stdout:Installed size: 126 M 2024-09-17T08:58:46.698 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-17T08:58:46.851 INFO:teuthology.orchestra.run.smithi179.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 332 kB/s | 36 kB 00:00 2024-09-17T08:58:46.892 INFO:teuthology.orchestra.run.smithi161.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-17T08:58:47.659 INFO:teuthology.orchestra.run.smithi161.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-17T08:58:47.659 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-17T08:58:47.659 INFO:teuthology.orchestra.run.smithi161.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-17T08:58:48.341 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-17T08:58:48.688 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-17T08:58:48.689 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-17T08:58:49.527 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.1 MB/s | 16 MB 00:03 2024-09-17T08:58:49.610 INFO:teuthology.orchestra.run.smithi179.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-17T08:58:49.658 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-17T08:58:49.659 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-17T08:58:50.644 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 7.0 MB/s | 29 MB 00:04 2024-09-17T08:58:51.645 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.7 MB/s | 35 MB 00:05 2024-09-17T08:58:51.645 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-17T08:58:51.645 INFO:teuthology.orchestra.run.smithi042.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-17T08:58:52.070 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-17T08:58:52.354 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-17T08:58:52.693 INFO:teuthology.orchestra.run.smithi179.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 4.9 MB/s | 29 MB 00:05 2024-09-17T08:58:52.738 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-17T08:58:52.738 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-17T08:58:52.764 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T08:58:52.859 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:58:53.009 INFO:teuthology.orchestra.run.smithi179.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 5.5 MB/s | 35 MB 00:06 2024-09-17T08:58:53.010 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-17T08:58:53.010 INFO:teuthology.orchestra.run.smithi179.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-17T08:58:53.696 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-17T08:58:53.752 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-17T08:58:53.753 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-17T08:58:54.034 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-17T08:58:54.034 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-17T08:58:55.030 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-17T08:58:55.030 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-17T08:58:55.627 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:58:55.762 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:58:56.331 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-17T08:58:56.989 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T08:58:57.071 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:58:57.496 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-17T08:58:58.137 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T08:58:58.310 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:58:59.821 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:58:59.959 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:00.578 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:00.687 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:01.080 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:59:01.195 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:05.092 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:05.135 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:05.545 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:06.047 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:06.145 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:10.280 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:11.032 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:43.713 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:43.752 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:44.114 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:44.114 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T08:59:44.114 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:59:44.114 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T08:59:45.006 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T08:59:45.007 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-17T08:59:45.367 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T08:59:45.456 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:45.456 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T08:59:45.456 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T08:59:45.457 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T08:59:45.457 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T08:59:45.457 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T08:59:45.457 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T08:59:45.457 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T08:59:45.517 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:45.517 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T08:59:45.517 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2024-09-17T08:59:45.550 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.06 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 82.el9 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Group : Unspecified 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 8274670 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T08:59:45.551 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : builder@centos.org 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2024-09-17T08:59:45.552 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T08:59:45.553 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T08:59:45.553 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T08:59:45.554 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 5.14.0-508.el9.x86_64 2024-09-17T08:59:45.554 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T08:59:46.196 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-09-17T08:59:47.434 INFO:teuthology.orchestra.run.smithi161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T08:59:47.461 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-09-17T08:59:47.470 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-09-17T08:59:47.485 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.5KpCJt45M8 2024-09-17T08:59:47.486 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5KpCJt45M8 2024-09-17T08:59:47.562 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.5KpCJt45M8 2024-09-17T08:59:47.699 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.5KpCJt45M8 is 6KB 2024-09-17T08:59:47.748 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.5KpCJt45M8 2024-09-17T08:59:47.763 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T08:59:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T08:59:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T08:59:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T08:59:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T08:59:47.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T08:59:47.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-09-17T08:59:49.652 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:49.693 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:49.865 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:50.039 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:50.039 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T08:59:50.039 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:59:50.040 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:50.206 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:50.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T08:59:50.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T08:59:50.206 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T08:59:50.900 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T08:59:50.901 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-17T08:59:51.019 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T08:59:51.019 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T08:59:51.019 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-17T08:59:51.019 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.019 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.019 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.019 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.020 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T08:59:51.020 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-17T08:59:51.264 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T08:59:51.349 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.349 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.349 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.349 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T08:59:51.349 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T08:59:51.350 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-17T08:59:51.350 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T08:59:51.350 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T08:59:51.354 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T08:59:51.409 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.409 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.409 DEBUG:teuthology.orchestra.run.smithi179:> sudo rpm -qi grub2-tools 2024-09-17T08:59:51.440 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.440 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.440 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.440 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T08:59:51.441 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T08:59:51.441 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T08:59:51.441 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T08:59:51.441 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Name : grub2-tools 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Epoch : 1 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Version : 2.06 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Release : 82.el9 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: x86_64 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Group : Unspecified 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:Size : 8274670 2024-09-17T08:59:51.444 INFO:teuthology.orchestra.run.smithi179.stdout:License : GPLv3+ 2024-09-17T08:59:51.445 INFO:teuthology.orchestra.run.smithi179.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T08:59:51.445 INFO:teuthology.orchestra.run.smithi179.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T08:59:51.445 INFO:teuthology.orchestra.run.smithi179.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T08:59:51.445 INFO:teuthology.orchestra.run.smithi179.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:Packager : builder@centos.org 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:Vendor : CentOS 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:Summary : Support tools for GRUB. 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:Description : 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:hardware devices. 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T08:59:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T08:59:51.447 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T08:59:51.447 INFO:teuthology.task.kernel:Updating grub on smithi179 to boot 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T08:59:51.498 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T08:59:51.499 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.499 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 82.el9 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-09-17T08:59:51.539 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8274670 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T08:59:51.540 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T08:59:51.541 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T08:59:51.541 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-09-17T08:59:51.541 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T08:59:51.541 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T08:59:51.542 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T08:59:51.542 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-508.el9.x86_64 2024-09-17T08:59:51.542 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T08:59:52.154 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-09-17T08:59:52.245 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-09-17T08:59:53.410 INFO:teuthology.orchestra.run.smithi179.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T08:59:53.441 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-09-17T08:59:53.442 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-09-17T08:59:53.458 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.2Iy4uRLsZu 2024-09-17T08:59:53.458 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2Iy4uRLsZu 2024-09-17T08:59:53.525 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T08:59:53.526 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.2Iy4uRLsZu 2024-09-17T08:59:53.554 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-09-17T08:59:53.556 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-09-17T08:59:53.574 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.OXOTfGOX3G 2024-09-17T08:59:53.574 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OXOTfGOX3G 2024-09-17T08:59:53.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.OXOTfGOX3G 2024-09-17T08:59:53.663 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.2Iy4uRLsZu is 6KB 2024-09-17T08:59:53.711 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.2Iy4uRLsZu 2024-09-17T08:59:53.726 DEBUG:teuthology.orchestra.run.smithi179:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T08:59:53.788 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T08:59:53.788 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T08:59:53.788 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T08:59:53.789 INFO:teuthology.orchestra.run.smithi179.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T08:59:53.790 DEBUG:teuthology.orchestra.run.smithi179:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T08:59:53.792 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.OXOTfGOX3G is 6KB 2024-09-17T08:59:53.841 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.OXOTfGOX3G 2024-09-17T08:59:53.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T08:59:53.912 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-09-17T08:59:53.918 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T08:59:53.919 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T08:59:53.919 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T08:59:53.919 INFO:teuthology.orchestra.run.smithi042.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T08:59:53.920 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T08:59:54.070 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-09-17T09:00:18.013 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T09:00:18.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T09:00:18.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:00:23.921 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-17T09:00:23.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T09:00:23.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:00:23.994 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-17T09:00:24.074 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T09:00:24.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T09:00:24.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:00:28.070 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-17T09:00:35.144 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-17T09:00:36.541 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-17T09:00:42.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-09-17T09:00:45.215 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-17T09:00:45.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T09:00:45.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:00:48.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-17T09:00:51.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T09:00:51.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:01:00.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T09:01:00.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:01:13.776 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-09-17T09:01:19.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-09-17T09:01:29.858 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:u39nzc3pYo4JE7FYuw8cJRNU5uH44suKtq6OOxU+q80), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtNXhMYP9o1FCknOmfZzNQb8LgzoJkIjOBPT8LhrKL3zheRq+n1Dj+eNduUwnF5jsXODeon2xvNc22BIzr/mbw=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-17T09:01:34.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T09:01:34.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:01:34.466 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-17T09:01:34.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T09:01:34.906 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T09:01:34.907 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-09-17T09:01:34.921 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-508.el9.x86_64 2024-09-17T09:01:34.921 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T09:01:34.921 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T09:01:34.921 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T09:01:35.922 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T09:01:35.923 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T09:01:35.999 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-09-17T09:01:36.023 DEBUG:teuthology.parallel:result is None 2024-09-17T09:01:48.879 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:u39nzc3pYo4JE7FYuw8cJRNU5uH44suKtq6OOxU+q80), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtNXhMYP9o1FCknOmfZzNQb8LgzoJkIjOBPT8LhrKL3zheRq+n1Dj+eNduUwnF5jsXODeon2xvNc22BIzr/mbw=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-17T09:01:51.433 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T09:02:03.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T09:02:03.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:02:03.836 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-17T09:02:04.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T09:02:04.167 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T09:02:04.168 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-09-17T09:02:04.185 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-508.el9.x86_64 2024-09-17T09:02:04.186 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T09:02:04.186 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T09:02:04.186 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T09:02:05.187 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T09:02:05.187 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T09:02:05.283 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-09-17T09:02:05.311 DEBUG:teuthology.parallel:result is None 2024-09-17T09:02:10.899 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:u39nzc3pYo4JE7FYuw8cJRNU5uH44suKtq6OOxU+q80), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtNXhMYP9o1FCknOmfZzNQb8LgzoJkIjOBPT8LhrKL3zheRq+n1Dj+eNduUwnF5jsXODeon2xvNc22BIzr/mbw=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-17T09:02:35.918 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:u39nzc3pYo4JE7FYuw8cJRNU5uH44suKtq6OOxU+q80), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtNXhMYP9o1FCknOmfZzNQb8LgzoJkIjOBPT8LhrKL3zheRq+n1Dj+eNduUwnF5jsXODeon2xvNc22BIzr/mbw=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-17T09:03:03.937 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: BadHostKeyException('smithi179.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:u39nzc3pYo4JE7FYuw8cJRNU5uH44suKtq6OOxU+q80), PKey(alg=ED25519, bits=256, fp=SHA256:W+6Y/LgnRby4510vqEHFE/6fAReT8MdM2qNnjG5ecjQ)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi179.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtNXhMYP9o1FCknOmfZzNQb8LgzoJkIjOBPT8LhrKL3zheRq+n1Dj+eNduUwnF5jsXODeon2xvNc22BIzr/mbw=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIDnVB65LQ2ZrorCmRDXT/imYcIqttYXGdAR7PyxJCGep' 2024-09-17T09:03:03.938 DEBUG:teuthology.orchestra.remote:'connect to smithi179.front.sepia.ceph.com' reached maximum tries (10) after waiting for 145 seconds 2024-09-17T09:03:12.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T09:03:12.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:03:13.316 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-17T09:03:13.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T09:03:13.703 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-17T09:03:13.703 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-09-17T09:03:13.721 INFO:teuthology.orchestra.run.smithi179.stdout:5.14.0-508.el9.x86_64 2024-09-17T09:03:13.721 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T09:03:13.721 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T09:03:13.721 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T09:03:14.721 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-17T09:03:14.722 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T09:03:14.817 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-09-17T09:03:14.837 DEBUG:teuthology.parallel:result is None 2024-09-17T09:03:14.837 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T09:03:14.845 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T09:03:14.845 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T09:03:14.848 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T09:03:14.852 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T09:03:14.870 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T09:03:14.897 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T09:03:14.910 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T09:03:14.910 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T09:03:14.913 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T09:03:14.915 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T09:03:14.974 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T09:03:14.980 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T09:03:14.981 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T09:03:14.983 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T09:03:14.986 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T09:03:15.022 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T09:03:15.023 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T09:03:15.034 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T09:03:15.035 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T09:03:15.037 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T09:03:15.049 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T09:03:15.051 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T09:03:15.058 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T09:03:15.058 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T09:03:15.060 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T09:03:15.079 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T09:03:15.106 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T09:03:15.116 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T09:03:15.117 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T09:03:15.130 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T09:03:15.148 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T09:03:15.164 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T09:03:15.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T09:03:15.290 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T09:03:15.334 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T09:03:15.377 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:03:15.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T09:03:15.445 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T09:03:15.490 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T09:03:15.539 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T09:03:15.625 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T09:03:15.668 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:03:15.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T09:03:15.738 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T09:03:15.784 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T09:03:15.870 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T09:03:15.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T09:03:15.959 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:03:15.959 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T09:03:16.026 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-09-17T09:03:16.029 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-09-17T09:03:16.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-09-17T09:03:16.076 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T09:03:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T09:03:16.115 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T09:03:16.566 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T09:03:16.574 INFO:teuthology.task.internal:Starting timer... 2024-09-17T09:03:16.574 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T09:03:16.760 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T09:03:16.769 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-17T09:03:16.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-09-17T09:03:16.834 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-09-17T09:03:16.837 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2024-09-17T09:03:16.925 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2024-09-17T09:03:16.927 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2024-09-17T09:03:16.980 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2024-09-17T09:03:16.981 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T09:03:16.982 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-09-17T09:03:17.009 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-09-17T09:03:17.009 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2024-09-17T09:03:17.034 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2024-09-17T09:03:17.035 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2024-09-17T09:03:17.064 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2024-09-17T09:03:17.064 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi179.front.sepia.ceph.com': 'permissive'} 2024-09-17T09:03:17.064 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T09:03:17.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:03:17.095 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T09:03:17.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:03:17.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T09:03:17.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:03:17.154 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T09:03:17.154 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-09-17T09:03:17.190 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2024-09-17T09:03:17.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2024-09-17T09:03:17.254 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T09:03:17.264 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T09:03:17.276 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T09:03:17.277 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi161.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T09:07:05.049 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-09-17T09:07:05.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T09:07:05.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:07:05.135 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-09-17T09:07:05.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-09-17T09:07:05.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T09:07:05.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:07:05.298 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-09-17T09:07:05.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-09-17T09:07:05.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T09:07:05.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T09:07:05.455 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-09-17T09:07:05.539 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-09-17T09:07:05.540 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T09:07:05.555 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T09:07:05.555 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T09:07:05.556 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:07:05.558 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T09:07:05.558 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:07:05.561 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T09:07:05.561 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:07:05.588 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T09:07:05.589 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T09:07:05.603 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T09:07:05.606 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T09:07:05.612 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T09:07:05.627 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2024-09-17T09:07:05.628 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T09:07:05.632 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-09-17T09:07:05.638 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2024-09-17T09:07:05.645 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-09-17T09:07:05.653 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T09:07:05.654 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2024-09-17T09:07:05.660 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T09:07:05.666 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2024-09-17T09:07:05.668 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T09:07:05.675 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T09:07:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T09:07:05.696 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T09:07:05.723 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-09-17T09:07:05.726 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T09:07:05.726 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-09-17T09:07:05.727 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.727 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.727 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.727 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.732 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-17T09:07:05.735 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T09:07:05.736 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-17T09:07:05.736 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.736 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.736 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.736 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.749 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-17T09:07:05.752 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T09:07:05.752 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-17T09:07:05.752 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.752 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.752 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.752 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:07:05.753 INFO:teuthology.run_tasks:Running task pexec... 2024-09-17T09:07:05.763 INFO:teuthology.task.pexec:Executing custom commands... 2024-09-17T09:07:05.763 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T09:07:05.763 DEBUG:teuthology.orchestra.run.smithi042:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-17T09:07:05.764 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi161.front.sepia.ceph.com 2024-09-17T09:07:05.764 DEBUG:teuthology.orchestra.run.smithi161:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-17T09:07:05.764 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T09:07:05.764 DEBUG:teuthology.orchestra.run.smithi179:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-09-17T09:07:06.118 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:Removing: 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:Removing unused dependencies: 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-17T09:07:06.132 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T09:07:06.133 INFO:teuthology.orchestra.run.smithi161.stdout:Remove 2 Packages 2024-09-17T09:07:06.133 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:06.133 INFO:teuthology.orchestra.run.smithi161.stdout:Freed space: 5.5 M 2024-09-17T09:07:06.133 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-17T09:07:06.136 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-17T09:07:06.136 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-17T09:07:06.145 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-17T09:07:06.145 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout:Removing: 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout:Removing unused dependencies: 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:06.148 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-17T09:07:06.149 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T09:07:06.149 INFO:teuthology.orchestra.run.smithi042.stdout:Remove 2 Packages 2024-09-17T09:07:06.149 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:06.149 INFO:teuthology.orchestra.run.smithi042.stdout:Freed space: 5.5 M 2024-09-17T09:07:06.149 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-17T09:07:06.153 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-17T09:07:06.153 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-17T09:07:06.158 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T09:07:06.158 INFO:teuthology.orchestra.run.smithi179.stdout: Package Architecture Version Repository Size 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout:Removing: 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout: nvme-cli x86_64 2.9.1-6.el9 @baseos 5.3 M 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout:Removing unused dependencies: 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout: libnvme x86_64 1.9-3.el9 @baseos 273 k 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout:Remove 2 Packages 2024-09-17T09:07:06.159 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:06.160 INFO:teuthology.orchestra.run.smithi179.stdout:Freed space: 5.5 M 2024-09-17T09:07:06.160 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-17T09:07:06.163 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-17T09:07:06.163 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-17T09:07:06.193 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-17T09:07:06.193 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-17T09:07:06.214 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-17T09:07:06.215 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-17T09:07:06.220 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-17T09:07:06.220 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-17T09:07:06.326 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-17T09:07:06.349 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-17T09:07:06.363 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-17T09:07:06.417 INFO:teuthology.orchestra.run.smithi161.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-17T09:07:06.431 INFO:teuthology.orchestra.run.smithi179.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-17T09:07:06.446 INFO:teuthology.orchestra.run.smithi042.stdout: Erasing : nvme-cli-2.9.1-6.el9.x86_64 1/2 2024-09-17T09:07:06.472 INFO:teuthology.orchestra.run.smithi161.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-17T09:07:06.496 INFO:teuthology.orchestra.run.smithi179.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-17T09:07:06.506 INFO:teuthology.orchestra.run.smithi042.stdout: Erasing : libnvme-1.9-3.el9.x86_64 2/2 2024-09-17T09:07:06.977 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-17T09:07:06.977 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-17T09:07:07.002 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-17T09:07:07.002 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-17T09:07:07.045 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libnvme-1.9-3.el9.x86_64 2/2 2024-09-17T09:07:07.045 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/2 2024-09-17T09:07:07.217 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-17T09:07:07.218 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:07.218 INFO:teuthology.orchestra.run.smithi161.stdout:Removed: 2024-09-17T09:07:07.218 INFO:teuthology.orchestra.run.smithi161.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-17T09:07:07.218 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:07.218 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-17T09:07:07.285 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-17T09:07:07.285 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:07.285 INFO:teuthology.orchestra.run.smithi179.stdout:Removed: 2024-09-17T09:07:07.285 INFO:teuthology.orchestra.run.smithi179.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-17T09:07:07.285 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:07.285 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-17T09:07:07.371 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/2 2024-09-17T09:07:07.371 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:07.371 INFO:teuthology.orchestra.run.smithi042.stdout:Removed: 2024-09-17T09:07:07.371 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-17T09:07:07.371 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:07.371 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-17T09:07:08.109 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 09:06:16 AM UTC. 2024-09-17T09:07:08.202 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Sep 2024 09:06:16 AM UTC. 2024-09-17T09:07:08.237 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Sep 2024 09:06:21 AM UTC. 2024-09-17T09:07:08.246 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-09-17T09:07:08.246 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: runc x86_64 4:1.1.13-4.el9 appstream 3.2 M 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-17T09:07:08.247 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:08.248 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-09-17T09:07:08.248 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-09-17T09:07:08.248 INFO:teuthology.orchestra.run.smithi161.stdout:Install 7 Packages 2024-09-17T09:07:08.248 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:08.254 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 5.2 M 2024-09-17T09:07:08.255 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 19 M 2024-09-17T09:07:08.255 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-09-17T09:07:08.337 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2024-09-17T09:07:08.337 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T09:07:08.337 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: runc x86_64 4:1.1.13-4.el9 appstream 3.2 M 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2024-09-17T09:07:08.338 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2024-09-17T09:07:08.339 INFO:teuthology.orchestra.run.smithi179.stdout:Install 7 Packages 2024-09-17T09:07:08.339 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:08.355 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 5.2 M 2024-09-17T09:07:08.356 INFO:teuthology.orchestra.run.smithi179.stdout:Installed size: 19 M 2024-09-17T09:07:08.356 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2024-09-17T09:07:08.375 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout: nvme-cli x86_64 2.9.1-6.el9 baseos 906 k 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout: nvmetcli noarch 0.7-3.el9 baseos 44 k 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout: runc x86_64 4:1.1.13-4.el9 appstream 3.2 M 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme x86_64 1.9-3.el9 baseos 106 k 2024-09-17T09:07:08.376 INFO:teuthology.orchestra.run.smithi042.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2024-09-17T09:07:08.377 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2024-09-17T09:07:08.377 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2024-09-17T09:07:08.377 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:08.377 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-09-17T09:07:08.377 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-09-17T09:07:08.377 INFO:teuthology.orchestra.run.smithi042.stdout:Install 7 Packages 2024-09-17T09:07:08.377 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:08.388 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 5.2 M 2024-09-17T09:07:08.388 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 19 M 2024-09-17T09:07:08.388 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-09-17T09:07:08.700 INFO:teuthology.orchestra.run.smithi042.stdout:(1/7): nvmetcli-0.7-3.el9.noarch.rpm 422 kB/s | 44 kB 00:00 2024-09-17T09:07:08.744 INFO:teuthology.orchestra.run.smithi179.stdout:(1/7): nvmetcli-0.7-3.el9.noarch.rpm 516 kB/s | 44 kB 00:00 2024-09-17T09:07:08.744 INFO:teuthology.orchestra.run.smithi042.stdout:(2/7): libnvme-1.9-3.el9.x86_64.rpm 712 kB/s | 106 kB 00:00 2024-09-17T09:07:08.769 INFO:teuthology.orchestra.run.smithi179.stdout:(2/7): libnvme-1.9-3.el9.x86_64.rpm 949 kB/s | 106 kB 00:00 2024-09-17T09:07:08.776 INFO:teuthology.orchestra.run.smithi042.stdout:(3/7): python3-configshell-1.1.30-1.el9.noarch. 951 kB/s | 72 kB 00:00 2024-09-17T09:07:08.801 INFO:teuthology.orchestra.run.smithi042.stdout:(4/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.4 MB/s | 84 kB 00:00 2024-09-17T09:07:08.819 INFO:teuthology.orchestra.run.smithi179.stdout:(3/7): nvme-cli-2.9.1-6.el9.x86_64.rpm 5.5 MB/s | 906 kB 00:00 2024-09-17T09:07:08.845 INFO:teuthology.orchestra.run.smithi179.stdout:(4/7): python3-configshell-1.1.30-1.el9.noarch. 711 kB/s | 72 kB 00:00 2024-09-17T09:07:08.851 INFO:teuthology.orchestra.run.smithi042.stdout:(5/7): nvme-cli-2.9.1-6.el9.x86_64.rpm 3.4 MB/s | 906 kB 00:00 2024-09-17T09:07:08.870 INFO:teuthology.orchestra.run.smithi179.stdout:(5/7): python3-kmod-0.9-32.el9.x86_64.rpm 836 kB/s | 84 kB 00:00 2024-09-17T09:07:08.903 INFO:teuthology.orchestra.run.smithi179.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 9.8 MB/s | 837 kB 00:00 2024-09-17T09:07:08.919 INFO:teuthology.orchestra.run.smithi042.stdout:(6/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 5.8 MB/s | 837 kB 00:00 2024-09-17T09:07:09.077 INFO:teuthology.orchestra.run.smithi042.stdout:(7/7): runc-1.1.13-4.el9.x86_64.rpm 11 MB/s | 3.2 MB 00:00 2024-09-17T09:07:09.077 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-17T09:07:09.078 INFO:teuthology.orchestra.run.smithi042.stdout:Total 7.5 MB/s | 5.2 MB 00:00 2024-09-17T09:07:09.120 INFO:teuthology.orchestra.run.smithi161.stdout:(1/7): nvmetcli-0.7-3.el9.noarch.rpm 69 kB/s | 44 kB 00:00 2024-09-17T09:07:09.154 INFO:teuthology.orchestra.run.smithi161.stdout:(2/7): libnvme-1.9-3.el9.x86_64.rpm 157 kB/s | 106 kB 00:00 2024-09-17T09:07:09.191 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-09-17T09:07:09.208 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-09-17T09:07:09.208 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-09-17T09:07:09.387 INFO:teuthology.orchestra.run.smithi161.stdout:(3/7): nvme-cli-2.9.1-6.el9.x86_64.rpm 996 kB/s | 906 kB 00:00 2024-09-17T09:07:09.545 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-09-17T09:07:09.545 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-09-17T09:07:09.746 INFO:teuthology.orchestra.run.smithi161.stdout:(4/7): python3-configshell-1.1.30-1.el9.noarch. 115 kB/s | 72 kB 00:00 2024-09-17T09:07:09.863 INFO:teuthology.orchestra.run.smithi161.stdout:(5/7): python3-kmod-0.9-32.el9.x86_64.rpm 119 kB/s | 84 kB 00:00 2024-09-17T09:07:09.929 INFO:teuthology.orchestra.run.smithi179.stdout:(7/7): runc-1.1.13-4.el9.x86_64.rpm 2.9 MB/s | 3.2 MB 00:01 2024-09-17T09:07:09.929 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2024-09-17T09:07:09.929 INFO:teuthology.orchestra.run.smithi179.stdout:Total 3.3 MB/s | 5.2 MB 00:01 2024-09-17T09:07:10.036 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-09-17T09:07:10.048 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2024-09-17T09:07:10.063 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2024-09-17T09:07:10.064 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2024-09-17T09:07:10.121 INFO:teuthology.orchestra.run.smithi161.stdout:(6/7): runc-1.1.13-4.el9.x86_64.rpm 8.4 MB/s | 3.2 MB 00:00 2024-09-17T09:07:10.123 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2024-09-17T09:07:10.158 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/7 2024-09-17T09:07:10.193 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/7 2024-09-17T09:07:10.288 INFO:teuthology.orchestra.run.smithi161.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 938 kB/s | 837 kB 00:00 2024-09-17T09:07:10.288 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-09-17T09:07:10.289 INFO:teuthology.orchestra.run.smithi161.stdout:Total 2.5 MB/s | 5.2 MB 00:02 2024-09-17T09:07:10.358 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2024-09-17T09:07:10.358 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2024-09-17T09:07:10.408 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-09-17T09:07:10.415 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/7 2024-09-17T09:07:10.424 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-09-17T09:07:10.424 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-09-17T09:07:10.449 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-17T09:07:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-09-17T09:07:10.729 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-09-17T09:07:10.829 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2024-09-17T09:07:10.921 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-17T09:07:10.923 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2024-09-17T09:07:10.954 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/7 2024-09-17T09:07:10.958 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/7 2024-09-17T09:07:10.986 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/7 2024-09-17T09:07:11.075 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/7 2024-09-17T09:07:11.141 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:11.193 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/7 2024-09-17T09:07:11.202 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-09-17T09:07:11.225 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-17T09:07:11.298 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 1/7 2024-09-17T09:07:11.334 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 2/7 2024-09-17T09:07:11.362 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 3/7 2024-09-17T09:07:11.575 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libnvme-1.9-3.el9.x86_64 4/7 2024-09-17T09:07:11.602 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-17T09:07:11.669 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-17T09:07:11.695 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/7 2024-09-17T09:07:11.812 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/7 2024-09-17T09:07:11.873 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:12.048 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: nvme-cli-2.9.1-6.el9.x86_64 5/7 2024-09-17T09:07:12.087 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : nvmetcli-0.7-3.el9.noarch 6/7 2024-09-17T09:07:12.121 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:12.122 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/7 2024-09-17T09:07:12.122 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/7 2024-09-17T09:07:12.122 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/7 2024-09-17T09:07:12.122 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/7 2024-09-17T09:07:12.122 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/7 2024-09-17T09:07:12.122 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2024-09-17T09:07:12.195 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: nvmetcli-0.7-3.el9.noarch 6/7 2024-09-17T09:07:12.257 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:12.486 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: runc-4:1.1.13-4.el9.x86_64 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:07:12.487 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-09-17T09:07:12.864 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:12.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/7 2024-09-17T09:07:12.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/7 2024-09-17T09:07:12.864 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/7 2024-09-17T09:07:12.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/7 2024-09-17T09:07:12.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/7 2024-09-17T09:07:12.865 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2024-09-17T09:07:12.866 DEBUG:teuthology.parallel:result is None 2024-09-17T09:07:13.284 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:13.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libnvme-1.9-3.el9.x86_64 1/7 2024-09-17T09:07:13.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : nvme-cli-2.9.1-6.el9.x86_64 2/7 2024-09-17T09:07:13.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : nvmetcli-0.7-3.el9.noarch 3/7 2024-09-17T09:07:13.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 4/7 2024-09-17T09:07:13.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 5/7 2024-09-17T09:07:13.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/7 2024-09-17T09:07:13.398 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:13.398 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:13.399 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2024-09-17T09:07:13.399 INFO:teuthology.orchestra.run.smithi179.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-17T09:07:13.399 INFO:teuthology.orchestra.run.smithi179.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-17T09:07:13.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-17T09:07:13.399 INFO:teuthology.orchestra.run.smithi179.stdout: runc-4:1.1.13-4.el9.x86_64 2024-09-17T09:07:13.399 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:07:13.399 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : runc-4:1.1.13-4.el9.x86_64 7/7 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout: libnvme-1.9-3.el9.x86_64 nvme-cli-2.9.1-6.el9.x86_64 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout: nvmetcli-0.7-3.el9.noarch python3-configshell-1:1.1.30-1.el9.noarch 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kmod-0.9-32.el9.x86_64 python3-urwid-2.1.2-4.el9.x86_64 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout: runc-4:1.1.13-4.el9.x86_64 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-09-17T09:07:13.617 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-09-17T09:07:13.800 DEBUG:teuthology.parallel:result is None 2024-09-17T09:07:14.044 DEBUG:teuthology.parallel:result is None 2024-09-17T09:07:14.044 INFO:teuthology.run_tasks:Running task nvme_loop... 2024-09-17T09:07:14.055 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices... 2024-09-17T09:07:14.055 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:07:14.055 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:07:14.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T09:07:14.077 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-09-17T09:07:14.136 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 968 Links: 1 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:07:11.383976028 +0000 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.137 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.137 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T09:07:14.206 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:07:14.206 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:07:14.206 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000118401 s, 4.3 MB/s 2024-09-17T09:07:14.207 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T09:07:14.268 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-09-17T09:07:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T09:07:14.327 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:14.327 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 967 Links: 1 2024-09-17T09:07:14.328 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:14.328 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:14.328 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:07:11.383976028 +0000 2024-09-17T09:07:14.328 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.328 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.328 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.328 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T09:07:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:07:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:07:14.396 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000104629 s, 4.9 MB/s 2024-09-17T09:07:14.398 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T09:07:14.458 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 974 Links: 1 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:07:11.383976028 +0000 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:11.043913981 +0000 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:11.043913981 +0000 2024-09-17T09:07:14.518 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:11.043913981 +0000 2024-09-17T09:07:14.519 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T09:07:14.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:07:14.587 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:07:14.587 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000118844 s, 4.3 MB/s 2024-09-17T09:07:14.588 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T09:07:14.648 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-09-17T09:07:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T09:07:14.707 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:14.708 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 964 Links: 1 2024-09-17T09:07:14.708 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:14.708 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:14.708 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:07:11.384976211 +0000 2024-09-17T09:07:14.708 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.708 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.708 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:11.042913799 +0000 2024-09-17T09:07:14.708 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T09:07:14.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:07:14.775 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:07:14.775 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000100643 s, 5.1 MB/s 2024-09-17T09:07:14.777 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T09:07:14.837 DEBUG:teuthology.orchestra.run.smithi042:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2024-09-17T09:07:14.998 INFO:teuthology.orchestra.run.smithi042.stdout:loop 2024-09-17T09:07:14.999 INFO:tasks.nvme_loop:Connecting nvme_loop smithi042:/dev/vg_nvme/lv_1... 2024-09-17T09:07:14.999 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2024-09-17T09:07:15.036 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T09:07:15.068 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/vg_nvme/lv_11 2024-09-17T09:07:15.111 INFO:teuthology.orchestra.run.smithi042.stdout:connecting to device: nvme1 2024-09-17T09:07:15.113 INFO:tasks.nvme_loop:Connecting nvme_loop smithi042:/dev/vg_nvme/lv_2... 2024-09-17T09:07:15.113 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2024-09-17T09:07:15.205 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T09:07:15.238 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/vg_nvme/lv_21 2024-09-17T09:07:15.270 INFO:teuthology.orchestra.run.smithi042.stdout:connecting to device: nvme2 2024-09-17T09:07:15.272 INFO:tasks.nvme_loop:Connecting nvme_loop smithi042:/dev/vg_nvme/lv_3... 2024-09-17T09:07:15.272 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2024-09-17T09:07:15.308 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T09:07:15.340 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/vg_nvme/lv_31 2024-09-17T09:07:15.372 INFO:teuthology.orchestra.run.smithi042.stdout:connecting to device: nvme3 2024-09-17T09:07:15.374 INFO:tasks.nvme_loop:Connecting nvme_loop smithi042:/dev/vg_nvme/lv_4... 2024-09-17T09:07:15.374 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2024-09-17T09:07:15.450 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-09-17T09:07:15.483 INFO:teuthology.orchestra.run.smithi042.stdout:/dev/vg_nvme/lv_41 2024-09-17T09:07:15.516 INFO:teuthology.orchestra.run.smithi042.stdout:connecting to device: nvme4 2024-09-17T09:07:15.518 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:07:15.518 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:07:15.574 DEBUG:teuthology.orchestra.run.smithi042:> sudo nvme list -o json 2024-09-17T09:07:15.640 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T09:07:15.640 INFO:teuthology.orchestra.run.smithi042.stdout: "Devices":[ 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "NameSpace":1, 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "DevicePath":"/dev/nvme4n1", 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "GenericPath":"/dev/ng4n1", 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "SerialNumber":"bdad157bf0b30d63c488", 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: "SectorSize":512 2024-09-17T09:07:15.641 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "NameSpace":1, 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "DevicePath":"/dev/nvme3n1", 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "GenericPath":"/dev/ng3n1", 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "SerialNumber":"c2498412215c5097b081", 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: "SectorSize":512 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T09:07:15.642 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "NameSpace":1, 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "DevicePath":"/dev/nvme2n1", 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "GenericPath":"/dev/ng2n1", 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "SerialNumber":"f6df757c291092e3ebc8", 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "SectorSize":512 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T09:07:15.643 INFO:teuthology.orchestra.run.smithi042.stdout: "NameSpace":1, 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "DevicePath":"/dev/nvme1n1", 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "GenericPath":"/dev/ng1n1", 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "SerialNumber":"fc43f448c65ba9dbfdc3", 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "SectorSize":512 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: { 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "NameSpace":1, 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "DevicePath":"/dev/nvme0n1", 2024-09-17T09:07:15.644 INFO:teuthology.orchestra.run.smithi042.stdout: "GenericPath":"/dev/ng0n1", 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "Firmware":"E2010325", 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "ModelNumber":"INTEL SSDPED1D480GA", 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "SerialNumber":"PHMB75130021480DGN", 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "UsedBytes":480103981056, 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "MaximumLBA":937703088, 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "PhysicalSize":480103981056, 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: "SectorSize":512 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: } 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T09:07:15.645 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T09:07:15.646 INFO:tasks.nvme_loop:new_devs ['/dev/nvme4n1', '/dev/nvme3n1', '/dev/nvme2n1', '/dev/nvme1n1'] 2024-09-17T09:07:15.646 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:07:15.646 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/scratch_devs 2024-09-17T09:07:15.712 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:07:15.712 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:07:15.732 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T09:07:15.732 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-09-17T09:07:15.790 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T09:07:15.790 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:15.791 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 969 Links: 1 2024-09-17T09:07:15.791 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:15.791 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:15.791 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:07:12.479616808 +0000 2024-09-17T09:07:15.791 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:15.791 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:15.791 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:15.791 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T09:07:15.857 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:07:15.857 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:07:15.857 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000197047 s, 2.6 MB/s 2024-09-17T09:07:15.858 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T09:07:15.917 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-09-17T09:07:15.973 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T09:07:15.973 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:15.973 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 977 Links: 1 2024-09-17T09:07:15.973 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:15.974 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:15.974 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:07:12.480616785 +0000 2024-09-17T09:07:15.974 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:15.974 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:15.974 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:15.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T09:07:16.037 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:07:16.037 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:07:16.037 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000203375 s, 2.5 MB/s 2024-09-17T09:07:16.039 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T09:07:16.096 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-09-17T09:07:16.153 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T09:07:16.153 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:16.153 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 976 Links: 1 2024-09-17T09:07:16.153 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:16.153 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:16.153 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:07:12.480616785 +0000 2024-09-17T09:07:16.153 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:16.154 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:16.154 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:16.154 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T09:07:16.217 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:07:16.217 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:07:16.217 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000191695 s, 2.7 MB/s 2024-09-17T09:07:16.218 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T09:07:16.274 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-09-17T09:07:16.330 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T09:07:16.330 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:16.330 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 973 Links: 1 2024-09-17T09:07:16.330 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:16.330 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:16.332 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:07:12.481616763 +0000 2024-09-17T09:07:16.332 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:16.332 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:16.332 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:12.164623907 +0000 2024-09-17T09:07:16.332 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T09:07:16.393 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:07:16.394 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:07:16.394 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000211443 s, 2.4 MB/s 2024-09-17T09:07:16.395 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T09:07:16.451 DEBUG:teuthology.orchestra.run.smithi161:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2024-09-17T09:07:16.595 INFO:teuthology.orchestra.run.smithi161.stdout:loop 2024-09-17T09:07:16.597 INFO:tasks.nvme_loop:Connecting nvme_loop smithi161:/dev/vg_nvme/lv_1... 2024-09-17T09:07:16.597 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2024-09-17T09:07:16.630 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-09-17T09:07:16.659 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_11 2024-09-17T09:07:16.722 INFO:teuthology.orchestra.run.smithi161.stdout:connecting to device: nvme1 2024-09-17T09:07:16.724 INFO:tasks.nvme_loop:Connecting nvme_loop smithi161:/dev/vg_nvme/lv_2... 2024-09-17T09:07:16.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2024-09-17T09:07:16.800 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-09-17T09:07:16.831 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_21 2024-09-17T09:07:16.867 INFO:teuthology.orchestra.run.smithi161.stdout:connecting to device: nvme2 2024-09-17T09:07:16.869 INFO:tasks.nvme_loop:Connecting nvme_loop smithi161:/dev/vg_nvme/lv_3... 2024-09-17T09:07:16.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2024-09-17T09:07:16.942 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-09-17T09:07:16.977 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_31 2024-09-17T09:07:17.013 INFO:teuthology.orchestra.run.smithi161.stdout:connecting to device: nvme3 2024-09-17T09:07:17.015 INFO:tasks.nvme_loop:Connecting nvme_loop smithi161:/dev/vg_nvme/lv_4... 2024-09-17T09:07:17.015 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2024-09-17T09:07:17.089 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-09-17T09:07:17.119 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_41 2024-09-17T09:07:17.150 INFO:teuthology.orchestra.run.smithi161.stdout:connecting to device: nvme4 2024-09-17T09:07:17.152 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:07:17.152 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:07:17.208 DEBUG:teuthology.orchestra.run.smithi161:> sudo nvme list -o json 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout: "Devices":[ 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout: "NameSpace":1, 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout: "DevicePath":"/dev/nvme4n1", 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout: "GenericPath":"/dev/ng4n1", 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:17.274 INFO:teuthology.orchestra.run.smithi161.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "SerialNumber":"68adbbe58ce157a36796", 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "SectorSize":512 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "NameSpace":1, 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "DevicePath":"/dev/nvme3n1", 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "GenericPath":"/dev/ng3n1", 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:17.275 INFO:teuthology.orchestra.run.smithi161.stdout: "SerialNumber":"018cc697dd69583af748", 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "SectorSize":512 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "NameSpace":1, 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "DevicePath":"/dev/nvme2n1", 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "GenericPath":"/dev/ng2n1", 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:17.276 INFO:teuthology.orchestra.run.smithi161.stdout: "SerialNumber":"23b701aa144fd3699559", 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "SectorSize":512 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "NameSpace":1, 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "DevicePath":"/dev/nvme1n1", 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "GenericPath":"/dev/ng1n1", 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "SerialNumber":"6b4b092bb1b95d90cb09", 2024-09-17T09:07:17.277 INFO:teuthology.orchestra.run.smithi161.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "SectorSize":512 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: { 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "NameSpace":1, 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "DevicePath":"/dev/nvme0n1", 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "GenericPath":"/dev/ng0n1", 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "Firmware":"8DV101H0", 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "ModelNumber":"INTEL SSDPEDMD400G4", 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "SerialNumber":"CVFT6233001X400BGN", 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "UsedBytes":400088457216, 2024-09-17T09:07:17.278 INFO:teuthology.orchestra.run.smithi161.stdout: "MaximumLBA":781422768, 2024-09-17T09:07:17.279 INFO:teuthology.orchestra.run.smithi161.stdout: "PhysicalSize":400088457216, 2024-09-17T09:07:17.279 INFO:teuthology.orchestra.run.smithi161.stdout: "SectorSize":512 2024-09-17T09:07:17.279 INFO:teuthology.orchestra.run.smithi161.stdout: } 2024-09-17T09:07:17.279 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-17T09:07:17.279 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-17T09:07:17.280 INFO:tasks.nvme_loop:new_devs ['/dev/nvme4n1', '/dev/nvme3n1', '/dev/nvme2n1', '/dev/nvme1n1'] 2024-09-17T09:07:17.280 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:07:17.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/scratch_devs 2024-09-17T09:07:17.345 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:07:17.345 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:07:17.365 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T09:07:17.365 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-09-17T09:07:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 977 Links: 1 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:07:12.104209677 +0000 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:11.782216939 +0000 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:11.782216939 +0000 2024-09-17T09:07:17.424 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:11.782216939 +0000 2024-09-17T09:07:17.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T09:07:17.492 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:07:17.492 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:07:17.492 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000202175 s, 2.5 MB/s 2024-09-17T09:07:17.494 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T09:07:17.552 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 969 Links: 1 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:07:12.104209677 +0000 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:11.781216961 +0000 2024-09-17T09:07:17.610 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:11.781216961 +0000 2024-09-17T09:07:17.611 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:11.781216961 +0000 2024-09-17T09:07:17.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T09:07:17.675 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:07:17.675 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:07:17.675 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000199616 s, 2.6 MB/s 2024-09-17T09:07:17.677 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T09:07:17.734 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-09-17T09:07:17.790 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T09:07:17.790 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:17.790 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 983 Links: 1 2024-09-17T09:07:17.790 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:17.791 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:17.791 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:07:12.105209655 +0000 2024-09-17T09:07:17.791 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:11.783216916 +0000 2024-09-17T09:07:17.791 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:11.783216916 +0000 2024-09-17T09:07:17.791 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:11.783216916 +0000 2024-09-17T09:07:17.791 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T09:07:17.855 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:07:17.856 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:07:17.856 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000202583 s, 2.5 MB/s 2024-09-17T09:07:17.857 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T09:07:17.913 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-09-17T09:07:17.969 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T09:07:17.969 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T09:07:17.969 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 968 Links: 1 2024-09-17T09:07:17.969 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T09:07:17.969 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T09:07:17.970 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:07:12.105209655 +0000 2024-09-17T09:07:17.970 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:11.781216961 +0000 2024-09-17T09:07:17.970 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:11.781216961 +0000 2024-09-17T09:07:17.970 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:11.781216961 +0000 2024-09-17T09:07:17.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T09:07:18.034 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:07:18.034 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:07:18.034 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000231851 s, 2.2 MB/s 2024-09-17T09:07:18.035 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T09:07:18.092 DEBUG:teuthology.orchestra.run.smithi179:> grep '^nvme_loop' /proc/modules || sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2024-09-17T09:07:18.247 INFO:teuthology.orchestra.run.smithi179.stdout:loop 2024-09-17T09:07:18.249 INFO:tasks.nvme_loop:Connecting nvme_loop smithi179:/dev/vg_nvme/lv_1... 2024-09-17T09:07:18.249 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2024-09-17T09:07:18.282 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-17T09:07:18.315 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/vg_nvme/lv_11 2024-09-17T09:07:18.357 INFO:teuthology.orchestra.run.smithi179.stdout:connecting to device: nvme1 2024-09-17T09:07:18.359 INFO:tasks.nvme_loop:Connecting nvme_loop smithi179:/dev/vg_nvme/lv_2... 2024-09-17T09:07:18.359 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2024-09-17T09:07:18.444 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-17T09:07:18.472 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/vg_nvme/lv_21 2024-09-17T09:07:18.504 INFO:teuthology.orchestra.run.smithi179.stdout:connecting to device: nvme2 2024-09-17T09:07:18.506 INFO:tasks.nvme_loop:Connecting nvme_loop smithi179:/dev/vg_nvme/lv_3... 2024-09-17T09:07:18.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2024-09-17T09:07:18.580 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-17T09:07:18.610 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/vg_nvme/lv_31 2024-09-17T09:07:18.646 INFO:teuthology.orchestra.run.smithi179.stdout:connecting to device: nvme3 2024-09-17T09:07:18.648 INFO:tasks.nvme_loop:Connecting nvme_loop smithi179:/dev/vg_nvme/lv_4... 2024-09-17T09:07:18.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2024-09-17T09:07:18.723 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-09-17T09:07:18.753 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/vg_nvme/lv_41 2024-09-17T09:07:18.788 INFO:teuthology.orchestra.run.smithi179.stdout:connecting to device: nvme4 2024-09-17T09:07:18.790 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:07:18.790 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:07:18.847 DEBUG:teuthology.orchestra.run.smithi179:> sudo nvme list -o json 2024-09-17T09:07:18.912 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "Devices":[ 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "NameSpace":1, 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "DevicePath":"/dev/nvme4n1", 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "GenericPath":"/dev/ng4n1", 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "SerialNumber":"7d9137e9d05dc453c218", 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:18.913 INFO:teuthology.orchestra.run.smithi179.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "SectorSize":512 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "NameSpace":1, 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "DevicePath":"/dev/nvme3n1", 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "GenericPath":"/dev/ng3n1", 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "SerialNumber":"5a9bc9179530e8cc0b3a", 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:18.914 INFO:teuthology.orchestra.run.smithi179.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "SectorSize":512 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "NameSpace":1, 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "DevicePath":"/dev/nvme2n1", 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "GenericPath":"/dev/ng2n1", 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "SerialNumber":"3177dee585d51eac40d3", 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:18.915 INFO:teuthology.orchestra.run.smithi179.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "SectorSize":512 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "NameSpace":1, 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "DevicePath":"/dev/nvme1n1", 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "GenericPath":"/dev/ng1n1", 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "Firmware":"5.14.0-5", 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "ModelNumber":"Linux", 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "SerialNumber":"4d2f48bc57c16c284eb3", 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "UsedBytes":95995035648, 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "MaximumLBA":187490304, 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "PhysicalSize":95995035648, 2024-09-17T09:07:18.916 INFO:teuthology.orchestra.run.smithi179.stdout: "SectorSize":512 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: { 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "NameSpace":1, 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "DevicePath":"/dev/nvme0n1", 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "GenericPath":"/dev/ng0n1", 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "Firmware":"8DV101H0", 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "ModelNumber":"INTEL SSDPEDMD400G4", 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "SerialNumber":"CVFT6303009J400BGN", 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "UsedBytes":400088457216, 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "MaximumLBA":781422768, 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "PhysicalSize":400088457216, 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: "SectorSize":512 2024-09-17T09:07:18.917 INFO:teuthology.orchestra.run.smithi179.stdout: } 2024-09-17T09:07:18.918 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-17T09:07:18.918 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-17T09:07:18.919 INFO:tasks.nvme_loop:new_devs ['/dev/nvme4n1', '/dev/nvme3n1', '/dev/nvme2n1', '/dev/nvme1n1'] 2024-09-17T09:07:18.919 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:07:18.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/scratch_devs 2024-09-17T09:07:18.985 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-17T09:07:19.083 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'global': {'mon election default strategy': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'CEPHADM_AGENT_DOWN', 'CEPHADM_FAILED_DAEMON'], 'log-only-match': ['CEPHADM_'], 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9'} 2024-09-17T09:07:19.083 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T09:07:19.083 INFO:tasks.cephadm:Cluster fsid is 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:07:19.083 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-17T09:07:19.084 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.42', 'mon.b': '172.21.15.161', 'mon.c': '172.21.15.179'} 2024-09-17T09:07:19.084 INFO:tasks.cephadm:First mon is mon.a on smithi042 2024-09-17T09:07:19.084 INFO:tasks.cephadm:First mgr is y 2024-09-17T09:07:19.084 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-17T09:07:19.084 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname $(hostname -s) 2024-09-17T09:07:19.116 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname $(hostname -s) 2024-09-17T09:07:19.146 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname $(hostname -s) 2024-09-17T09:07:19.172 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-17T09:07:19.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T09:07:19.314 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56094/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-855-g19e2a2be', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-855.g19e2a2be'}, 'url': 'https://4.chacra.ceph.com/r/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-16 16:29:21.739533', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'reef', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-17T09:07:19.451 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref reef, sha1 19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T09:07:19.453 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm 2024-09-17T09:07:19.453 DEBUG:teuthology.orchestra.run.smithi042:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:19.832 INFO:teuthology.orchestra.run.smithi042.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 17 09:07 /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:19.832 DEBUG:teuthology.orchestra.run.smithi161:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:20.181 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 17 09:07 /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:20.181 DEBUG:teuthology.orchestra.run.smithi179:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/reef/19e2a2beb6f41a3ab62650e38614eb29b59dcbb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:20.492 INFO:teuthology.orchestra.run.smithi179.stdout:-rw-r--r--. 1 ubuntu ubuntu 217222 Sep 17 09:07 /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:20.492 DEBUG:teuthology.orchestra.run.smithi042:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:20.513 DEBUG:teuthology.orchestra.run.smithi161:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:20.533 DEBUG:teuthology.orchestra.run.smithi179:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-17T09:07:20.564 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 on all hosts... 2024-09-17T09:07:20.564 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 pull 2024-09-17T09:07:20.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 pull 2024-09-17T09:07:20.576 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 pull 2024-09-17T09:07:22.145 INFO:teuthology.orchestra.run.smithi161.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T09:07:22.185 INFO:teuthology.orchestra.run.smithi042.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T09:07:22.210 INFO:teuthology.orchestra.run.smithi179.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T09:07:50.425 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-09-17T09:07:50.426 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T09:07:50.426 INFO:teuthology.orchestra.run.smithi042.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-17T09:07:50.426 INFO:teuthology.orchestra.run.smithi042.stdout: "repo_digests": [ 2024-09-17T09:07:50.426 INFO:teuthology.orchestra.run.smithi042.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-17T09:07:50.426 INFO:teuthology.orchestra.run.smithi042.stdout: ] 2024-09-17T09:07:50.426 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-09-17T09:07:55.945 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2024-09-17T09:07:55.945 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T09:07:55.945 INFO:teuthology.orchestra.run.smithi161.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-17T09:07:55.946 INFO:teuthology.orchestra.run.smithi161.stdout: "repo_digests": [ 2024-09-17T09:07:55.946 INFO:teuthology.orchestra.run.smithi161.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-17T09:07:55.946 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2024-09-17T09:07:55.946 INFO:teuthology.orchestra.run.smithi161.stdout:} 2024-09-17T09:08:03.250 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2024-09-17T09:08:03.250 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable)", 2024-09-17T09:08:03.250 INFO:teuthology.orchestra.run.smithi179.stdout: "image_id": "980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89", 2024-09-17T09:08:03.250 INFO:teuthology.orchestra.run.smithi179.stdout: "repo_digests": [ 2024-09-17T09:08:03.250 INFO:teuthology.orchestra.run.smithi179.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9" 2024-09-17T09:08:03.250 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2024-09-17T09:08:03.250 INFO:teuthology.orchestra.run.smithi179.stdout:} 2024-09-17T09:08:03.269 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph 2024-09-17T09:08:03.303 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph 2024-09-17T09:08:03.336 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph 2024-09-17T09:08:03.364 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /etc/ceph 2024-09-17T09:08:03.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /etc/ceph 2024-09-17T09:08:03.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /etc/ceph 2024-09-17T09:08:03.448 INFO:tasks.cephadm:Writing seed config... 2024-09-17T09:08:03.449 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-17T09:08:03.449 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-17T09:08:03.449 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-09-17T09:08:03.450 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-09-17T09:08:03.450 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-17T09:08:03.450 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-17T09:08:03.450 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-17T09:08:03.450 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-17T09:08:03.450 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-17T09:08:03.450 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-17T09:08:03.451 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:08:03.451 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-17T09:08:03.469 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3dd20088-74d4-11ef-bceb-c7b262605968 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-17T09:08:03.469 DEBUG:teuthology.orchestra.run.smithi042:mon.a> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service 2024-09-17T09:08:03.512 DEBUG:teuthology.orchestra.run.smithi042:mgr.y> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y.service 2024-09-17T09:08:03.555 INFO:tasks.cephadm:Bootstrapping... 2024-09-17T09:08:03.555 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 -v bootstrap --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.42 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:08:03.717 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-09-17T09:08:03.717 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9', '-v', 'bootstrap', '--fsid', '3dd20088-74d4-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.42', '--skip-admin-label'] 2024-09-17T09:08:03.742 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.2 2024-09-17T09:08:03.742 INFO:teuthology.orchestra.run.smithi042.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-17T09:08:03.743 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying podman|docker is present... 2024-09-17T09:08:03.765 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.2 2024-09-17T09:08:03.765 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying lvm2 is present... 2024-09-17T09:08:03.765 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying time synchronization is in place... 2024-09-17T09:08:03.773 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T09:08:03.773 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T09:08:03.780 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T09:08:03.780 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-17T09:08:03.787 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-09-17T09:08:03.794 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-09-17T09:08:03.794 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-09-17T09:08:03.794 INFO:teuthology.orchestra.run.smithi042.stdout:Repeating the final host check... 2024-09-17T09:08:03.817 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 5.2.2 2024-09-17T09:08:03.817 INFO:teuthology.orchestra.run.smithi042.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-17T09:08:03.817 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl is present 2024-09-17T09:08:03.817 INFO:teuthology.orchestra.run.smithi042.stdout:lvcreate is present 2024-09-17T09:08:03.824 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-17T09:08:03.824 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-17T09:08:03.830 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-17T09:08:03.830 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-17T09:08:03.837 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout enabled 2024-09-17T09:08:03.845 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout active 2024-09-17T09:08:03.845 INFO:teuthology.orchestra.run.smithi042.stdout:Unit chronyd.service is enabled and running 2024-09-17T09:08:03.845 INFO:teuthology.orchestra.run.smithi042.stdout:Host looks OK 2024-09-17T09:08:03.845 INFO:teuthology.orchestra.run.smithi042.stdout:Cluster fsid: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:03.846 INFO:teuthology.orchestra.run.smithi042.stdout:Acquiring lock 140592962785440 on /run/cephadm/3dd20088-74d4-11ef-bceb-c7b262605968.lock 2024-09-17T09:08:03.846 INFO:teuthology.orchestra.run.smithi042.stdout:Lock 140592962785440 acquired on /run/cephadm/3dd20088-74d4-11ef-bceb-c7b262605968.lock 2024-09-17T09:08:03.846 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 3300 ... 2024-09-17T09:08:03.846 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying IP 172.21.15.42 port 6789 ... 2024-09-17T09:08:03.846 INFO:teuthology.orchestra.run.smithi042.stdout:Base mon IP(s) is [172.21.15.42:3300, 172.21.15.42:6789], mon addrv is [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-17T09:08:03.849 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.42 metric 100 2024-09-17T09:08:03.849 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.42 metric 100 2024-09-17T09:08:03.852 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-17T09:08:03.852 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-17T09:08:03.852 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1771sec hoplimit 64 pref medium 2024-09-17T09:08:03.855 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-17T09:08:03.855 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-17T09:08:03.855 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T09:08:03.855 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-17T09:08:03.855 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1440/64 scope link 2024-09-17T09:08:03.856 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-17T09:08:03.857 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-09-17T09:08:03.857 INFO:teuthology.orchestra.run.smithi042.stdout:Mon IP `172.21.15.42` is in CIDR network `172.21.0.0/20` 2024-09-17T09:08:03.857 INFO:teuthology.orchestra.run.smithi042.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-17T09:08:03.857 INFO:teuthology.orchestra.run.smithi042.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-17T09:08:03.857 INFO:teuthology.orchestra.run.smithi042.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T09:08:04.811 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stdout 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 2024-09-17T09:08:04.811 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9... 2024-09-17T09:08:04.811 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Getting image source signatures 2024-09-17T09:08:04.811 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-17T09:08:04.811 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying blob sha256:d8a707c21dc06a64315160cb2d8e524fa91943a344731b2a930ee3a716bebbdd 2024-09-17T09:08:04.812 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Copying config sha256:980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 2024-09-17T09:08:04.812 INFO:teuthology.orchestra.run.smithi042.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-17T09:08:05.747 INFO:teuthology.orchestra.run.smithi042.stdout:ceph: stdout ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-17T09:08:05.748 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph version: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable) 2024-09-17T09:08:05.748 INFO:teuthology.orchestra.run.smithi042.stdout:Extracting ceph user uid/gid from container image... 2024-09-17T09:08:06.644 INFO:teuthology.orchestra.run.smithi042.stdout:stat: stdout 167 167 2024-09-17T09:08:06.644 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial keys... 2024-09-17T09:08:07.491 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD2RulmsDZVOxAA70Jj6DsG1wN16/mvCaj17Q== 2024-09-17T09:08:08.488 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD3Rulm4CVIMRAAUdiDUyUsn5pjo+7HZLVaiQ== 2024-09-17T09:08:09.519 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph-authtool: stdout AQD4Rulmmv4YMhAAQKbvFfa3JjNl3VYU1Eylug== 2024-09-17T09:08:09.520 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial monmap... 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool for a [v2:172.21.15.42:3300,v1:172.21.15.42:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = pacific 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: set fsid to 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-17T09:08:18.909 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:08:18.910 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mon... 2024-09-17T09:08:22.046 INFO:teuthology.orchestra.run.smithi042.stdout:create mon.a on 2024-09-17T09:08:22.416 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-17T09:08:22.624 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3dd20088-74d4-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-3dd20088-74d4-11ef-bceb-c7b262605968.target. 2024-09-17T09:08:22.625 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3dd20088-74d4-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-3dd20088-74d4-11ef-bceb-c7b262605968.target. 2024-09-17T09:08:22.860 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a 2024-09-17T09:08:22.860 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-17T09:08:23.036 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3dd20088-74d4-11ef-bceb-c7b262605968.target.wants/ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-3dd20088-74d4-11ef-bceb-c7b262605968@.service. 2024-09-17T09:08:23.382 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:23 smithi042 podman[25389]: 2024-09-17 09:08:23.170175439 +0000 UTC m=+0.016210918 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T09:08:23.561 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T09:08:23.561 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-17T09:08:23.568 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T09:08:23.568 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-17T09:08:23.568 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-17T09:08:23.568 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T09:08:23.568 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon to start... 2024-09-17T09:08:23.568 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mon... 2024-09-17T09:08:23.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:23 smithi042 podman[25389]: 2024-09-17 09:08:23.455324969 +0000 UTC m=+0.301360438 container init 710f96fe45d6e223806ad6754fcf7f07549221c7aaa609713954bddf3848c066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True) 2024-09-17T09:08:23.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:23 smithi042 podman[25389]: 2024-09-17 09:08:23.460604228 +0000 UTC m=+0.306639687 container start 710f96fe45d6e223806ad6754fcf7f07549221c7aaa609713954bddf3848c066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2) 2024-09-17T09:08:23.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:23 smithi042 ceph-mon[25426]: mkfs 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:23.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:23 smithi042 ceph-mon[25426]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T09:08:23.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:23 smithi042 bash[25389]: 710f96fe45d6e223806ad6754fcf7f07549221c7aaa609713954bddf3848c066 2024-09-17T09:08:23.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:23 smithi042 systemd[1]: Started Ceph mon.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:08:24.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:24 smithi042 ceph-mon[25426]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T09:08:24.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:24 smithi042 ceph-mon[25426]: monmap e1: 1 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:08:24.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:24 smithi042 ceph-mon[25426]: fsmap 2024-09-17T09:08:24.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:24 smithi042 ceph-mon[25426]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T09:08:24.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:24 smithi042 ceph-mon[25426]: mgrmap e1: no daemons active 2024-09-17T09:08:24.645 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:24 smithi042 ceph-mon[25426]: from='client.? 172.21.15.42:0/4126014575' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout cluster: 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout id: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout services: 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.569559s) 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout data: 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-17T09:08:24.649 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-17T09:08:24.650 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-17T09:08:24.650 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout pgs: 2024-09-17T09:08:24.650 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:24.650 INFO:teuthology.orchestra.run.smithi042.stdout:mon is available 2024-09-17T09:08:24.650 INFO:teuthology.orchestra.run.smithi042.stdout:Assimilating anything we can from ceph.conf... 2024-09-17T09:08:25.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:25 smithi042 ceph-mon[25426]: from='client.? 172.21.15.42:0/3410742026' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T09:08:25.684 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:25 smithi042 ceph-mon[25426]: from='client.? 172.21.15.42:0/3410742026' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.42:3300,v1:172.21.15.42:6789] 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:25.688 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T09:08:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/cephadm/use_agent = True 2024-09-17T09:08:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T09:08:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T09:08:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T09:08:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T09:08:25.689 INFO:teuthology.orchestra.run.smithi042.stdout:Generating new minimal ceph.conf... 2024-09-17T09:08:26.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:26 smithi042 ceph-mon[25426]: from='client.? 172.21.15.42:0/2758775167' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:08:27.385 INFO:teuthology.orchestra.run.smithi042.stdout:Restarting the monitor... 2024-09-17T09:08:27.655 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:27 smithi042 systemd[1]: Stopping Ceph mon.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:08:27.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:27 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a[25403]: 2024-09-17T09:08:27.653+0000 7f1c74dc7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:08:27.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:27 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a[25403]: 2024-09-17T09:08:27.653+0000 7f1c74dc7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-17T09:08:27.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:27 smithi042 podman[25746]: 2024-09-17 09:08:27.797476688 +0000 UTC m=+0.244920854 container died 710f96fe45d6e223806ad6754fcf7f07549221c7aaa609713954bddf3848c066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T09:08:28.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 podman[25746]: 2024-09-17 09:08:28.118146614 +0000 UTC m=+0.565590777 container cleanup 710f96fe45d6e223806ad6754fcf7f07549221c7aaa609713954bddf3848c066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-17T09:08:28.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 bash[25746]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a 2024-09-17T09:08:28.304 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 podman[25764]: 2024-09-17 09:08:28.302713749 +0000 UTC m=+0.505191060 container remove 710f96fe45d6e223806ad6754fcf7f07549221c7aaa609713954bddf3848c066 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux ) 2024-09-17T09:08:28.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T09:08:28.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 systemd[1]: Stopped Ceph mon.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:08:28.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 systemd[1]: Starting Ceph mon.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:08:29.022 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 podman[25860]: 2024-09-17 09:08:28.728336023 +0000 UTC m=+0.104435331 container create 01fa157211b768aef358ede997cd7e993590a1be7d851bc4b93e26281f5bf5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 podman[25860]: 2024-09-17 09:08:28.639958679 +0000 UTC m=+0.016057996 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 podman[25860]: 2024-09-17 09:08:28.939144035 +0000 UTC m=+0.315243343 container init 01fa157211b768aef358ede997cd7e993590a1be7d851bc4b93e26281f5bf5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 podman[25860]: 2024-09-17 09:08:28.944049014 +0000 UTC m=+0.320148321 container start 01fa157211b768aef358ede997cd7e993590a1be7d851bc4b93e26281f5bf5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 7 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: pidfile_write: ignore empty --pid-file 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: load: jerasure load: lrc 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: RocksDB version: 7.9.2 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Git sha 0 2024-09-17T09:08:29.023 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: DB SUMMARY 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: DB Session ID: D8MZJ6BKTXRQ2QDJ3NEY 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: CURRENT file: CURRENT 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 83740 ; 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.error_if_exists: 0 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.create_if_missing: 0 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.paranoid_checks: 1 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T09:08:29.024 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.env: 0x56226457bbc0 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.info_log: 0x562266c7abe0 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.statistics: (nil) 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.use_fsync: 0 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_log_file_size: 0 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.allow_fallocate: 1 2024-09-17T09:08:29.025 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.use_direct_reads: 0 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.db_log_dir: 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.wal_dir: 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T09:08:29.026 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.write_buffer_manager: 0x562266c88320 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T09:08:29.027 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T09:08:29.028 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.unordered_write: 0 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.row_cache: None 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.wal_filter: None 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.two_write_queues: 0 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T09:08:29.029 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.wal_compression: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.atomic_flush: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.log_readahead_size: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T09:08:29.030 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_background_jobs: 2 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_background_compactions: -1 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_subcompactions: 1 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_open_files: -1 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T09:08:29.031 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_background_flushes: -1 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Compression algorithms supported: 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kZSTD supported: 0 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kXpressCompression supported: 0 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kBZip2Compression supported: 0 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kLZ4Compression supported: 1 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kZlibCompression supported: 1 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: kSnappyCompression supported: 1 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T09:08:29.032 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.merge_operator: 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_filter: None 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562266c7a7e0) 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks: 1 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout: pin_top_level_index_and_filter: 1 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_type: 0 2024-09-17T09:08:29.033 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_index_type: 0 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_shortening: 1 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: checksum: 4 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: no_block_cache: 0 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache: 0x562266c6f350 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_name: BinnedLRUCache 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_options: 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: capacity : 536870912 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_shard_bits : 4 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: strict_capacity_limit : 0 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: high_pri_pool_ratio: 0.000 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_cache_compressed: (nil) 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: persistent_cache: (nil) 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size: 4096 2024-09-17T09:08:29.034 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_size_deviation: 10 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_restart_interval: 16 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: index_block_restart_interval: 1 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: metadata_block_size: 4096 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: partition_filters: 0 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: use_delta_encoding: 1 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: filter_policy: bloomfilter 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: whole_key_filtering: 1 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: verify_compression: 0 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: read_amp_bytes_per_bit: 0 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: format_version: 5 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_index_compression: 1 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: block_align: 0 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: max_auto_readahead_size: 262144 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: prepopulate_block_cache: 0 2024-09-17T09:08:29.035 INFO:journalctl@ceph.mon.a.smithi042.stdout: initial_auto_readahead_size: 8192 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression: NoCompression 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.num_levels: 7 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T09:08:29.036 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T09:08:29.037 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T09:08:29.038 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T09:08:29.039 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.inplace_update_support: 0 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T09:08:29.040 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.bloom_locality: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.max_successive_merges: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.ttl: 2592000 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.enable_blob_files: false 2024-09-17T09:08:29.041 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.min_blob_size: 0 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 633dadb4-dc9e-4e13-ab54-f5f6dc506a3b 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564108971015, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-17T09:08:29.042 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564108972013, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 80513, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 250, "table_properties": {"data_size": 78674, "index_size": 223, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 9896, "raw_average_key_size": 47, "raw_value_size": 72982, "raw_average_value_size": 349, "num_data_blocks": 10, "num_entries": 209, "num_filter_entries": 209, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726564108, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "633dadb4-dc9e-4e13-ab54-f5f6dc506a3b", "db_session_id": "D8MZJ6BKTXRQ2QDJ3NEY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564108972112, "job": 1, "event": "recovery_finished"} 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562266c9ae00 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: DB pointer 0x562266d8e000 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** DB Stats ** 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T09:08:29.043 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: L0 2/0 80.49 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: Sum 2/0 80.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** Compaction Stats [default] ** 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T09:08:29.044 INFO:journalctl@ceph.mon.a.smithi042.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: Cumulative compaction: 0.00 GB write, 23.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: Interval compaction: 0.00 GB write, 23.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T09:08:29.045 INFO:journalctl@ceph.mon.a.smithi042.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache BinnedLRUCache@0x562266c6f350#7 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: starting mon.a rank 0 at public addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] at bind addrs [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???) e1 preinit fsid 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???).mds e1 new map 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???).mds e1 print_map 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: e1 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: legacy client fscid: -1 2024-09-17T09:08:29.046 INFO:journalctl@ceph.mon.a.smithi042.stdout: 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout: No filesystems configured 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:28 smithi042 ceph-mon[25899]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:29 smithi042 bash[25860]: 01fa157211b768aef358ede997cd7e993590a1be7d851bc4b93e26281f5bf5cc 2024-09-17T09:08:29.047 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:29 smithi042 systemd[1]: Started Ceph mon.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:08:29.047 INFO:teuthology.orchestra.run.smithi042.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-17T09:08:29.374 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:29 smithi042 ceph-mon[25899]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-17T09:08:29.375 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:29 smithi042 ceph-mon[25899]: monmap e1: 1 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:08:29.375 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:29 smithi042 ceph-mon[25899]: fsmap 2024-09-17T09:08:29.375 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:29 smithi042 ceph-mon[25899]: osdmap e1: 0 total, 0 up, 0 in 2024-09-17T09:08:29.375 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:29 smithi042 ceph-mon[25899]: mgrmap e1: no daemons active 2024-09-17T09:08:30.039 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-17T09:08:30.061 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:08:30.061 INFO:teuthology.orchestra.run.smithi042.stdout:Creating mgr... 2024-09-17T09:08:30.061 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-17T09:08:30.062 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-17T09:08:30.325 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y 2024-09-17T09:08:30.325 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y.service: Unit ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y.service not loaded. 2024-09-17T09:08:30.503 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3dd20088-74d4-11ef-bceb-c7b262605968.target.wants/ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y.service → /etc/systemd/system/ceph-3dd20088-74d4-11ef-bceb-c7b262605968@.service. 2024-09-17T09:08:30.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:30 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1007909843' entity='client.admin' 2024-09-17T09:08:30.881 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:30 smithi042 podman[26136]: 2024-09-17 09:08:30.746925866 +0000 UTC m=+0.120911945 container create 2fc2c023ed1ebc3ee47d6bdc6c6323d37aedd75e11c960ffb9d7cee3af0bdfe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-17T09:08:31.105 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T09:08:31.106 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-17T09:08:31.113 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T09:08:31.113 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-17T09:08:31.113 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-17T09:08:31.114 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to enable service . firewalld.service is not available 2024-09-17T09:08:31.122 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T09:08:31.122 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-17T09:08:31.130 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T09:08:31.130 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-17T09:08:31.130 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-17T09:08:31.130 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-17T09:08:31.130 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr to start... 2024-09-17T09:08:31.130 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr... 2024-09-17T09:08:31.254 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:30 smithi042 podman[26136]: 2024-09-17 09:08:30.991065673 +0000 UTC m=+0.365051767 container init 2fc2c023ed1ebc3ee47d6bdc6c6323d37aedd75e11c960ffb9d7cee3af0bdfe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-17T09:08:31.254 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:30 smithi042 podman[26136]: 2024-09-17 09:08:30.996195227 +0000 UTC m=+0.370181306 container start 2fc2c023ed1ebc3ee47d6bdc6c6323d37aedd75e11c960ffb9d7cee3af0bdfe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-17T09:08:31.254 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 bash[26136]: 2fc2c023ed1ebc3ee47d6bdc6c6323d37aedd75e11c960ffb9d7cee3af0bdfe5 2024-09-17T09:08:31.255 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 systemd[1]: Started Ceph mgr.y for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:08:31.255 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:31.120+0000 7fd1bb126040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:08:31.255 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:31.182+0000 7fd1bb126040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:08:31.527 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:31.339+0000 7fd1bb126040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:08:31.527 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:31.412+0000 7fd1bb126040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:08:31.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:31 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3397733808' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T09:08:31.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:31.565+0000 7fd1bb126040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:08:31.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:31 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:31.719+0000 7fd1bb126040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:08:32.281 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:32 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:32.048+0000 7fd1bb126040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:08:32.281 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:32 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:32.111+0000 7fd1bb126040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:08:32.285 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "3dd20088-74d4-11ef-bceb-c7b262605968", 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:32.286 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T09:08:32.287 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T09:08:32.288 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T09:08:32.291 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T09:08:32.292 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T09:08:23.498949+0000", 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-17T09:08:32.293 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (1/15)... 2024-09-17T09:08:32.724 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:32 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:32.304+0000 7fd1bb126040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:08:33.474 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:33 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:33.215+0000 7fd1bb126040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:08:33.474 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:33 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:33.283+0000 7fd1bb126040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:08:34.308 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.039+0000 7fd1bb126040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:08:34.308 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.159+0000 7fd1bb126040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:08:34.308 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.307+0000 7fd1bb126040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:08:34.601 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.371+0000 7fd1bb126040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:08:34.601 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.527+0000 7fd1bb126040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:08:34.601 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.600+0000 7fd1bb126040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:08:34.900 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/312500336' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T09:08:34.900 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.663+0000 7fd1bb126040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:08:34.901 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.832+0000 7fd1bb126040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:08:34.901 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.899+0000 7fd1bb126040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:08:35.162 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:34 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:34.968+0000 7fd1bb126040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:08:35.162 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:35 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:35.058+0000 7fd1bb126040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:08:35.162 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:35 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:35.120+0000 7fd1bb126040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:08:35.438 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:35 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:35.182+0000 7fd1bb126040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:08:35.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:35.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-17T09:08:35.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "3dd20088-74d4-11ef-bceb-c7b262605968", 2024-09-17T09:08:35.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T09:08:35.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T09:08:35.445 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:35.446 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T09:08:35.447 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T09:08:35.448 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T09:08:23.498949+0000", 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:35.449 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T09:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-17T09:08:35.450 INFO:teuthology.orchestra.run.smithi042.stdout:mgr not available, waiting (2/15)... 2024-09-17T09:08:36.474 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:35 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:35.998+0000 7fd1bb126040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: Activating manager daemon y 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: mgrmap e2: y(active, starting, since 0.00312868s) 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: Manager daemon y is now available 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T09:08:36.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T09:08:36.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' 2024-09-17T09:08:36.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' 2024-09-17T09:08:36.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:36 smithi042 ceph-mon[25899]: from='mgr.14100 172.21.15.42:0/4184768762' entity='mgr.y' 2024-09-17T09:08:38.107 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:38 smithi042 ceph-mon[25899]: mgrmap e3: y(active, since 1.00724s) 2024-09-17T09:08:38.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:38.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-17T09:08:38.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsid": "3dd20088-74d4-11ef-bceb-c7b262605968", 2024-09-17T09:08:38.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "health": { 2024-09-17T09:08:38.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-17T09:08:38.665 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 0 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "a" 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-17T09:08:38.666 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-17T09:08:38.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:38.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-17T09:08:38.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:38.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-17T09:08:38.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-17T09:08:38.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-17T09:08:38.667 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-17T09:08:38.675 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-17T09:08:38.675 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-17T09:08:38.675 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:38.675 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-17T09:08:38.675 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-17T09:08:38.675 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-17T09:08:38.676 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-17T09:08:38.676 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-17T09:08:38.676 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-17T09:08:38.676 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-17T09:08:38.676 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-17T09:08:38.677 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-17T09:08:38.677 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:38.677 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-17T09:08:38.677 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:38.677 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-17T09:08:38.677 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-17T09:08:38.678 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:38.678 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-17T09:08:38.678 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T09:08:38.678 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-17T09:08:38.678 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-17T09:08:38.678 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-17T09:08:38.678 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "restful" 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ], 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "modified": "2024-09-17T09:08:23.498949+0000", 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout }, 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-17T09:08:38.679 INFO:teuthology.orchestra.run.smithi042.stdout:mgr is available 2024-09-17T09:08:39.278 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:39 smithi042 ceph-mon[25899]: mgrmap e4: y(active, since 2s) 2024-09-17T09:08:39.278 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:39 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2785022585' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-17T09:08:39.853 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [global] 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout fsid = 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout [osd] 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-17T09:08:39.854 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-17T09:08:39.855 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling cephadm module... 2024-09-17T09:08:40.219 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:40 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2809539121' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-17T09:08:40.219 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:40 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2809539121' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-17T09:08:41.297 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1725461827' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-17T09:08:41.297 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ignoring --setuser ceph since I am not root 2024-09-17T09:08:41.297 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ignoring --setgroup ceph since I am not root 2024-09-17T09:08:41.297 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:41.157+0000 7fc001439040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:08:41.297 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:41.215+0000 7fc001439040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:08:41.547 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:41.372+0000 7fc001439040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:08:41.547 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:41.441+0000 7fc001439040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:08:41.803 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:41.595+0000 7fc001439040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:08:41.803 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:41.742+0000 7fc001439040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:08:42.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:42 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1725461827' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-17T09:08:42.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:42 smithi042 ceph-mon[25899]: mgrmap e5: y(active, since 5s) 2024-09-17T09:08:42.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:42.070+0000 7fc001439040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:08:42.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:42.133+0000 7fc001439040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:08:42.474 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:42.329+0000 7fc001439040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:08:43.045 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:43 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2864245714' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-09-17T09:08:43.048 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 5... 2024-09-17T09:08:43.315 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:43 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:43.242+0000 7fc001439040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:08:43.315 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:43 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:43.314+0000 7fc001439040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:08:44.323 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.057+0000 7fc001439040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:08:44.323 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.176+0000 7fc001439040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:08:44.609 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.322+0000 7fc001439040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:08:44.609 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.386+0000 7fc001439040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:08:44.609 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.538+0000 7fc001439040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:08:44.610 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.608+0000 7fc001439040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:08:44.900 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.670+0000 7fc001439040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:08:44.900 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.832+0000 7fc001439040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:08:44.900 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.899+0000 7fc001439040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:08:45.176 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:44 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:44.968+0000 7fc001439040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:08:45.176 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:45 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:45.053+0000 7fc001439040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:08:45.176 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:45 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:45.115+0000 7fc001439040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:08:45.177 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:45 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:45.175+0000 7fc001439040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:08:46.474 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:45 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:45.986+0000 7fc001439040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:08:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: Active manager daemon y restarted 2024-09-17T09:08:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: Activating manager daemon y 2024-09-17T09:08:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: osdmap e2: 0 total, 0 up, 0 in 2024-09-17T09:08:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: mgrmap e6: y(active, starting, since 0.00327171s) 2024-09-17T09:08:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:08:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: Manager daemon y is now available 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T09:08:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:46 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T09:08:47.334 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:47 smithi042 ceph-mon[25899]: Found migration_current of "None". Setting to last migration. 2024-09-17T09:08:47.334 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:47 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:47.334 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:47 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:47.334 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:47 smithi042 ceph-mon[25899]: mgrmap e7: y(active, since 1.00519s) 2024-09-17T09:08:47.604 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-17T09:08:47.604 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-17T09:08:47.604 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T09:08:47.604 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-17T09:08:47.604 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 5 is available 2024-09-17T09:08:47.604 INFO:teuthology.orchestra.run.smithi042.stdout:Setting orchestrator backend to cephadm... 2024-09-17T09:08:48.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-mon[25899]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T09:08:48.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-mon[25899]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T09:08:48.793 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:48.661+0000 7fbf6e8e4640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:09:08:48] ENGINE Error in HTTPServer.serve 2024-09-17T09:08:48.793 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: Traceback (most recent call last): 2024-09-17T09:08:48.793 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:08:48.793 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._connections.run(self.expiration_interval) 2024-09-17T09:08:48.793 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:08:48.793 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._run(expiration_interval) 2024-09-17T09:08:48.793 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: s = self.context.wrap_socket( 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: return self.sslsocket_class._create( 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self.do_handshake() 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._sslobj.do_handshake() 2024-09-17T09:08:48.794 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:08:48.795 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:48 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:08:49.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:49 smithi042 ceph-mon[25899]: mgrmap e8: y(active, since 2s) 2024-09-17T09:08:49.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:49 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:49.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:49 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:49.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:49 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:49.957 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-17T09:08:49.957 INFO:teuthology.orchestra.run.smithi042.stdout:Generating ssh key... 2024-09-17T09:08:50.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-mon[25899]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:08:50.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-mon[25899]: [17/Sep/2024:09:08:48] ENGINE Bus STARTING 2024-09-17T09:08:50.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-mon[25899]: [17/Sep/2024:09:08:48] ENGINE Serving on https://172.21.15.42:7150 2024-09-17T09:08:50.365 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-mon[25899]: [17/Sep/2024:09:08:48] ENGINE Error in HTTPServer.serve 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-17T09:08:50.366 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-mon[25899]: [17/Sep/2024:09:08:48] ENGINE Serving on http://172.21.15.42:8765 2024-09-17T09:08:50.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-mon[25899]: [17/Sep/2024:09:08:48] ENGINE Bus STARTED 2024-09-17T09:08:50.625 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: Generating public/private rsa key pair. 2024-09-17T09:08:50.625 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: Your identification has been saved in /tmp/tmpo8zbja0a/key 2024-09-17T09:08:50.625 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: Your public key has been saved in /tmp/tmpo8zbja0a/key.pub 2024-09-17T09:08:50.625 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: The key fingerprint is: 2024-09-17T09:08:50.625 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: SHA256:m01VQLK3sXymNcNS5LqxAML0/R8E46N69Q5l6eTkjPo ceph-3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: The key's randomart image is: 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: +---[RSA 3072]----+ 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | . ..=.o | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | o . . + * | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | o o o * + | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | . . * X . | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | S + X # | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | * o ^ + | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | + o * B | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | . . o | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: | ..E . | 2024-09-17T09:08:50.626 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:08:50 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: +----[SHA256]-----+ 2024-09-17T09:08:51.160 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:51 smithi042 ceph-mon[25899]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:08:51.160 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:51 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:51.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:51 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:52.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:52 smithi042 ceph-mon[25899]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:08:52.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:52 smithi042 ceph-mon[25899]: Generating ssh key... 2024-09-17T09:08:52.368 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtzF8LffylnpRRF7nrYM/XLsbIJj6RvuS1L3O2WnHyIOO4/diF6X3AZZUfEWnqIFUEJSDykTZaqnpvhh3zQtF2/mZJBONMs5DxBGsV8B97xEyzgFHPDby5JJ8UHGoTVs8y4RmL6v1nWsCzplE3baYYgPbc/+NcRf62CrGErD/U7EAG2JEPEX53E+ksjhmKJJosZEgOgOd+zVbptr+t5fuHwsYSYldWYXB14Z/kPo7y5LW0X9XgcjOmDMnGJlZBY5ICLGG3bvDE3xWFFNqyePJ3EV+z0CxE0Qwtc+Y8C8gf/Ry5cpZCXVCyytkvE+R9j5KWv9k0jY7qhEQFMI76qG419tIz/8o05LkWeWdJjvBOTPTuGcfkDU8WkDaVkS9lVffNuyNv6wPGQnZvwl4aVjOJtJKF3aqWC1wXPebm9hBlcgkvpN4NFyfKEK+akcVXn/vBzahznIs9csd6UZCS7Pkur7Pl5wIOx4m+C119lAbRaxw8HeyEGfXdlJI0Y0nHBQk= ceph-3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:08:52.369 INFO:teuthology.orchestra.run.smithi042.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-17T09:08:52.369 INFO:teuthology.orchestra.run.smithi042.stdout:Adding key to root@localhost authorized_keys... 2024-09-17T09:08:52.372 INFO:teuthology.orchestra.run.smithi042.stdout:Adding host smithi042... 2024-09-17T09:08:53.340 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:53 smithi042 ceph-mon[25899]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:08:54.299 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:54 smithi042 ceph-mon[25899]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi042", "addr": "172.21.15.42", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:08:55.194 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:55 smithi042 ceph-mon[25899]: Deploying cephadm binary to smithi042 2024-09-17T09:08:56.829 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Added host 'smithi042' with addr '172.21.15.42' 2024-09-17T09:08:56.829 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mon service... 2024-09-17T09:08:57.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:57 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:57.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:57 smithi042 ceph-mon[25899]: Added host smithi042 2024-09-17T09:08:57.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:57 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:08:58.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:58 smithi042 ceph-mon[25899]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:08:58.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:58 smithi042 ceph-mon[25899]: Saving service mon spec with placement count:5 2024-09-17T09:08:58.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:58 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:58.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:58 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:58.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:08:58 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:08:58.889 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-17T09:08:58.889 INFO:teuthology.orchestra.run.smithi042.stdout:Deploying unmanaged mgr service... 2024-09-17T09:09:00.759 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-17T09:09:00.879 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:00.879 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: Saving service mgr spec with placement count:2 2024-09-17T09:09:00.879 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:09:00.879 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:09:00.879 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:09:00.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:09:00.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' 2024-09-17T09:09:00.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi042", "caps": []}]: dispatch 2024-09-17T09:09:00.880 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:00 smithi042 ceph-mon[25899]: from='mgr.14118 172.21.15.42:0/1240114113' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi042", "caps": []}]': finished 2024-09-17T09:09:02.642 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:02 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2612124690' entity='client.admin' 2024-09-17T09:09:03.188 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling the dashboard module... 2024-09-17T09:09:03.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:03 smithi042 ceph-mon[25899]: Deploying daemon agent.smithi042 on smithi042 2024-09-17T09:09:03.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:03 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2718643636' entity='client.admin' 2024-09-17T09:09:04.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:04 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1323060138' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-17T09:09:04.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:04 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ignoring --setuser ceph since I am not root 2024-09-17T09:09:04.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:04 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ignoring --setgroup ceph since I am not root 2024-09-17T09:09:04.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:04 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:04.784+0000 7fcb8c815040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:09:04.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:04 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:04.843+0000 7fcb8c815040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:09:05.259 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:04.999+0000 7fcb8c815040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:09:05.259 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:05.067+0000 7fcb8c815040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:09:05.259 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:05.218+0000 7fcb8c815040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:09:05.520 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:05.370+0000 7fcb8c815040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:09:05.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1323060138' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-17T09:09:05.955 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-mon[25899]: mgrmap e9: y(active, since 18s) 2024-09-17T09:09:05.956 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:05.698+0000 7fcb8c815040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:09:05.956 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:05.764+0000 7fcb8c815040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:09:06.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:05 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:05.955+0000 7fcb8c815040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:09:06.443 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-17T09:09:06.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-17T09:09:06.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-17T09:09:06.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-09-17T09:09:06.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-17T09:09:06.444 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-17T09:09:06.444 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for the mgr to restart... 2024-09-17T09:09:06.444 INFO:teuthology.orchestra.run.smithi042.stdout:Waiting for mgr epoch 9... 2024-09-17T09:09:06.842 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:06 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3581486030' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-17T09:09:07.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:06 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:06.884+0000 7fcb8c815040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:09:07.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:06 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:06.955+0000 7fcb8c815040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:09:07.963 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:07 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:07.695+0000 7fcb8c815040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:09:07.963 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:07 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:07.814+0000 7fcb8c815040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:09:08.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:07 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:07.961+0000 7fcb8c815040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:09:08.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.024+0000 7fcb8c815040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:09:08.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.176+0000 7fcb8c815040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:09:08.538 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.246+0000 7fcb8c815040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:09:08.538 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.307+0000 7fcb8c815040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:09:08.538 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.469+0000 7fcb8c815040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:09:08.538 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.536+0000 7fcb8c815040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:09:08.814 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.605+0000 7fcb8c815040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:09:08.814 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.690+0000 7fcb8c815040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:09:08.814 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.751+0000 7fcb8c815040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:09:08.814 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:08 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:08.812+0000 7fcb8c815040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:09:09.885 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:09.621+0000 7fcb8c815040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: Active manager daemon y restarted 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: Activating manager daemon y 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: osdmap e3: 0 total, 0 up, 0 in 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: mgrmap e10: y(active, starting, since 0.0031808s) 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T09:09:09.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: Manager daemon y is now available 2024-09-17T09:09:09.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:09.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:09.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T09:09:09.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:09 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T09:09:11.486 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout { 2024-09-17T09:09:11.486 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-17T09:09:11.486 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-17T09:09:11.486 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout } 2024-09-17T09:09:11.486 INFO:teuthology.orchestra.run.smithi042.stdout:mgr epoch 9 is available 2024-09-17T09:09:11.486 INFO:teuthology.orchestra.run.smithi042.stdout:Generating a dashboard self-signed certificate... 2024-09-17T09:09:11.735 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:11 smithi042 ceph-mon[25899]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-17T09:09:11.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:11 smithi042 ceph-mon[25899]: mgrmap e11: y(active, since 1.00539s) 2024-09-17T09:09:11.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:11 smithi042 ceph-mon[25899]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-17T09:09:11.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:11.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:09:11.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:11.736 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi042", "caps": []}]: dispatch 2024-09-17T09:09:12.447 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:12.013+0000 7fcaf2c5f640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:09:09:12] ENGINE Error in HTTPServer.serve 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: Traceback (most recent call last): 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._connections.run(self.expiration_interval) 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._run(expiration_interval) 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:09:12.448 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: s = self.context.wrap_socket( 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: return self.sslsocket_class._create( 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self.do_handshake() 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._sslobj.do_handshake() 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:09:12.449 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:09:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:09:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-17T09:09:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:Creating initial admin user... 2024-09-17T09:09:13.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: Deploying daemon agent.smithi042 on smithi042 2024-09-17T09:09:13.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: [17/Sep/2024:09:09:11] ENGINE Bus STARTING 2024-09-17T09:09:13.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: [17/Sep/2024:09:09:11] ENGINE Serving on http://172.21.15.42:8765 2024-09-17T09:09:13.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: [17/Sep/2024:09:09:12] ENGINE Serving on https://172.21.15.42:7150 2024-09-17T09:09:13.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: [17/Sep/2024:09:09:12] ENGINE Bus STARTED 2024-09-17T09:09:13.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: [17/Sep/2024:09:09:12] ENGINE Error in HTTPServer.serve 2024-09-17T09:09:13.474 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:09:13.475 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-17T09:09:13.476 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:09:13.476 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-17T09:09:13.476 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:09:13.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: mgrmap e12: y(active, since 2s) 2024-09-17T09:09:13.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:13.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:13.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:14.248 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$KYMzDyCh8engM4XozISCbectNZo6n2X.NQwv.MKaVQ2V3C9X9RIui", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726564153, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-17T09:09:14.248 INFO:teuthology.orchestra.run.smithi042.stdout:Fetching dashboard port number... 2024-09-17T09:09:14.371 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:14 smithi042 ceph-mon[25899]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:14.371 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:14 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:15.418 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:15 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1322707321' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-17T09:09:15.421 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stdout 8443 2024-09-17T09:09:15.431 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-17T09:09:15.431 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout disabled 2024-09-17T09:09:15.439 INFO:teuthology.orchestra.run.smithi042.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-17T09:09:15.439 INFO:teuthology.orchestra.run.smithi042.stdout:systemctl: stdout inactive 2024-09-17T09:09:15.439 INFO:teuthology.orchestra.run.smithi042.stdout:firewalld.service is not enabled 2024-09-17T09:09:15.439 INFO:teuthology.orchestra.run.smithi042.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-17T09:09:15.441 INFO:teuthology.orchestra.run.smithi042.stdout:Ceph Dashboard is now available at: 2024-09-17T09:09:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: URL: https://smithi042.front.sepia.ceph.com:8443/ 2024-09-17T09:09:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: User: admin 2024-09-17T09:09:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: Password: 3r2o4mnmf1 2024-09-17T09:09:15.441 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:15.442 INFO:teuthology.orchestra.run.smithi042.stdout:Saving cluster configuration to /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config directory 2024-09-17T09:09:15.442 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling autotune for osd_memory_target 2024-09-17T09:09:17.367 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:17 smithi042 ceph-mon[25899]: mgrmap e13: y(active, since 6s) 2024-09-17T09:09:17.900 INFO:teuthology.orchestra.run.smithi042.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-17T09:09:17.900 INFO:teuthology.orchestra.run.smithi042.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout:Or, if you are only running a single cluster on this host: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.901 INFO:teuthology.orchestra.run.smithi042.stdout: ceph telemetry on 2024-09-17T09:09:17.902 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.902 INFO:teuthology.orchestra.run.smithi042.stdout:For more information see: 2024-09-17T09:09:17.902 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.902 INFO:teuthology.orchestra.run.smithi042.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-17T09:09:17.902 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:17.902 INFO:teuthology.orchestra.run.smithi042.stdout:Bootstrap complete. 2024-09-17T09:09:17.941 INFO:tasks.cephadm:Fetching config... 2024-09-17T09:09:17.941 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:09:17.941 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-17T09:09:17.959 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-17T09:09:17.959 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:09:17.959 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-17T09:09:18.023 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-17T09:09:18.023 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:09:18.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-17T09:09:18.145 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-17T09:09:18.146 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:09:18.146 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-17T09:09:18.201 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-17T09:09:18.202 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtzF8LffylnpRRF7nrYM/XLsbIJj6RvuS1L3O2WnHyIOO4/diF6X3AZZUfEWnqIFUEJSDykTZaqnpvhh3zQtF2/mZJBONMs5DxBGsV8B97xEyzgFHPDby5JJ8UHGoTVs8y4RmL6v1nWsCzplE3baYYgPbc/+NcRf62CrGErD/U7EAG2JEPEX53E+ksjhmKJJosZEgOgOd+zVbptr+t5fuHwsYSYldWYXB14Z/kPo7y5LW0X9XgcjOmDMnGJlZBY5ICLGG3bvDE3xWFFNqyePJ3EV+z0CxE0Qwtc+Y8C8gf/Ry5cpZCXVCyytkvE+R9j5KWv9k0jY7qhEQFMI76qG419tIz/8o05LkWeWdJjvBOTPTuGcfkDU8WkDaVkS9lVffNuyNv6wPGQnZvwl4aVjOJtJKF3aqWC1wXPebm9hBlcgkvpN4NFyfKEK+akcVXn/vBzahznIs9csd6UZCS7Pkur7Pl5wIOx4m+C119lAbRaxw8HeyEGfXdlJI0Y0nHBQk= ceph-3dd20088-74d4-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T09:09:18.369 INFO:teuthology.orchestra.run.smithi042.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtzF8LffylnpRRF7nrYM/XLsbIJj6RvuS1L3O2WnHyIOO4/diF6X3AZZUfEWnqIFUEJSDykTZaqnpvhh3zQtF2/mZJBONMs5DxBGsV8B97xEyzgFHPDby5JJ8UHGoTVs8y4RmL6v1nWsCzplE3baYYgPbc/+NcRf62CrGErD/U7EAG2JEPEX53E+ksjhmKJJosZEgOgOd+zVbptr+t5fuHwsYSYldWYXB14Z/kPo7y5LW0X9XgcjOmDMnGJlZBY5ICLGG3bvDE3xWFFNqyePJ3EV+z0CxE0Qwtc+Y8C8gf/Ry5cpZCXVCyytkvE+R9j5KWv9k0jY7qhEQFMI76qG419tIz/8o05LkWeWdJjvBOTPTuGcfkDU8WkDaVkS9lVffNuyNv6wPGQnZvwl4aVjOJtJKF3aqWC1wXPebm9hBlcgkvpN4NFyfKEK+akcVXn/vBzahznIs9csd6UZCS7Pkur7Pl5wIOx4m+C119lAbRaxw8HeyEGfXdlJI0Y0nHBQk= ceph-3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:09:18.382 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtzF8LffylnpRRF7nrYM/XLsbIJj6RvuS1L3O2WnHyIOO4/diF6X3AZZUfEWnqIFUEJSDykTZaqnpvhh3zQtF2/mZJBONMs5DxBGsV8B97xEyzgFHPDby5JJ8UHGoTVs8y4RmL6v1nWsCzplE3baYYgPbc/+NcRf62CrGErD/U7EAG2JEPEX53E+ksjhmKJJosZEgOgOd+zVbptr+t5fuHwsYSYldWYXB14Z/kPo7y5LW0X9XgcjOmDMnGJlZBY5ICLGG3bvDE3xWFFNqyePJ3EV+z0CxE0Qwtc+Y8C8gf/Ry5cpZCXVCyytkvE+R9j5KWv9k0jY7qhEQFMI76qG419tIz/8o05LkWeWdJjvBOTPTuGcfkDU8WkDaVkS9lVffNuyNv6wPGQnZvwl4aVjOJtJKF3aqWC1wXPebm9hBlcgkvpN4NFyfKEK+akcVXn/vBzahznIs9csd6UZCS7Pkur7Pl5wIOx4m+C119lAbRaxw8HeyEGfXdlJI0Y0nHBQk= ceph-3dd20088-74d4-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T09:09:18.505 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:18 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3326313171' entity='client.admin' 2024-09-17T09:09:18.722 INFO:teuthology.orchestra.run.smithi161.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtzF8LffylnpRRF7nrYM/XLsbIJj6RvuS1L3O2WnHyIOO4/diF6X3AZZUfEWnqIFUEJSDykTZaqnpvhh3zQtF2/mZJBONMs5DxBGsV8B97xEyzgFHPDby5JJ8UHGoTVs8y4RmL6v1nWsCzplE3baYYgPbc/+NcRf62CrGErD/U7EAG2JEPEX53E+ksjhmKJJosZEgOgOd+zVbptr+t5fuHwsYSYldWYXB14Z/kPo7y5LW0X9XgcjOmDMnGJlZBY5ICLGG3bvDE3xWFFNqyePJ3EV+z0CxE0Qwtc+Y8C8gf/Ry5cpZCXVCyytkvE+R9j5KWv9k0jY7qhEQFMI76qG419tIz/8o05LkWeWdJjvBOTPTuGcfkDU8WkDaVkS9lVffNuyNv6wPGQnZvwl4aVjOJtJKF3aqWC1wXPebm9hBlcgkvpN4NFyfKEK+akcVXn/vBzahznIs9csd6UZCS7Pkur7Pl5wIOx4m+C119lAbRaxw8HeyEGfXdlJI0Y0nHBQk= ceph-3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:09:18.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtzF8LffylnpRRF7nrYM/XLsbIJj6RvuS1L3O2WnHyIOO4/diF6X3AZZUfEWnqIFUEJSDykTZaqnpvhh3zQtF2/mZJBONMs5DxBGsV8B97xEyzgFHPDby5JJ8UHGoTVs8y4RmL6v1nWsCzplE3baYYgPbc/+NcRf62CrGErD/U7EAG2JEPEX53E+ksjhmKJJosZEgOgOd+zVbptr+t5fuHwsYSYldWYXB14Z/kPo7y5LW0X9XgcjOmDMnGJlZBY5ICLGG3bvDE3xWFFNqyePJ3EV+z0CxE0Qwtc+Y8C8gf/Ry5cpZCXVCyytkvE+R9j5KWv9k0jY7qhEQFMI76qG419tIz/8o05LkWeWdJjvBOTPTuGcfkDU8WkDaVkS9lVffNuyNv6wPGQnZvwl4aVjOJtJKF3aqWC1wXPebm9hBlcgkvpN4NFyfKEK+akcVXn/vBzahznIs9csd6UZCS7Pkur7Pl5wIOx4m+C119lAbRaxw8HeyEGfXdlJI0Y0nHBQk= ceph-3dd20088-74d4-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-17T09:09:18.819 INFO:teuthology.orchestra.run.smithi179.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtzF8LffylnpRRF7nrYM/XLsbIJj6RvuS1L3O2WnHyIOO4/diF6X3AZZUfEWnqIFUEJSDykTZaqnpvhh3zQtF2/mZJBONMs5DxBGsV8B97xEyzgFHPDby5JJ8UHGoTVs8y4RmL6v1nWsCzplE3baYYgPbc/+NcRf62CrGErD/U7EAG2JEPEX53E+ksjhmKJJosZEgOgOd+zVbptr+t5fuHwsYSYldWYXB14Z/kPo7y5LW0X9XgcjOmDMnGJlZBY5ICLGG3bvDE3xWFFNqyePJ3EV+z0CxE0Qwtc+Y8C8gf/Ry5cpZCXVCyytkvE+R9j5KWv9k0jY7qhEQFMI76qG419tIz/8o05LkWeWdJjvBOTPTuGcfkDU8WkDaVkS9lVffNuyNv6wPGQnZvwl4aVjOJtJKF3aqWC1wXPebm9hBlcgkvpN4NFyfKEK+akcVXn/vBzahznIs9csd6UZCS7Pkur7Pl5wIOx4m+C119lAbRaxw8HeyEGfXdlJI0Y0nHBQk= ceph-3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:09:18.832 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-17T09:09:19.059 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.033 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:20.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:20.034 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:19 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:23.447 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-17T09:09:23.447 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-17T09:09:23.977 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:09:24.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:23 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3619673405' entity='client.admin' 2024-09-17T09:09:24.098 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:24.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:24.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:24.099 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:24.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:24 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:24.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:24 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:26.424 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi161 2024-09-17T09:09:26.424 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:09:26.424 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.conf 2024-09-17T09:09:26.443 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:09:26.443 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:09:26.501 INFO:tasks.cephadm:Adding host smithi161 to orchestrator... 2024-09-17T09:09:26.501 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch host add smithi161 2024-09-17T09:09:26.704 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:26.917 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:27.774 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:27 smithi042 ceph-mon[25899]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:09:27.774 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:27 smithi042 ceph-mon[25899]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:09:27.774 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:27 smithi042 ceph-mon[25899]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:09:29.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:28 smithi042 ceph-mon[25899]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi161", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:30.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:30 smithi042 ceph-mon[25899]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:30.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:30 smithi042 ceph-mon[25899]: Deploying cephadm binary to smithi161 2024-09-17T09:09:31.792 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi161' with addr '172.21.15.161' 2024-09-17T09:09:32.388 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T09:09:32.586 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:09:32.886 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:32.887 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:32 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:33.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:33 smithi042 ceph-mon[25899]: Added host smithi161 2024-09-17T09:09:33.829 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:33 smithi042 ceph-mon[25899]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-17T09:09:33.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:33 smithi042 ceph-mon[25899]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:09:33.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:33 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:33.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:33 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:33.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:33 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi161", "caps": []}]: dispatch 2024-09-17T09:09:33.830 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:33 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi161", "caps": []}]': finished 2024-09-17T09:09:34.528 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:34.528 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}] 2024-09-17T09:09:34.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:34 smithi042 ceph-mon[25899]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:09:34.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:34 smithi042 ceph-mon[25899]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:09:34.828 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:34 smithi042 ceph-mon[25899]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:35.110 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi179 2024-09-17T09:09:35.110 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:09:35.110 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.conf 2024-09-17T09:09:35.129 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:09:35.130 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:09:35.188 INFO:tasks.cephadm:Adding host smithi179 to orchestrator... 2024-09-17T09:09:35.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch host add smithi179 2024-09-17T09:09:35.391 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:09:35.781 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: Deploying daemon agent.smithi161 on smithi161 2024-09-17T09:09:35.781 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:09:35.781 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:35.781 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:35.781 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:35.781 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:35.781 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:35.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:35.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:35.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:35.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:35.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:35.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:35.782 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:36 smithi042 ceph-mon[25899]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:36 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:36 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:38.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:38 smithi042 ceph-mon[25899]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:38.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:38 smithi042 ceph-mon[25899]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:38.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:38 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:38.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:38 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:39.961 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:39 smithi042 ceph-mon[25899]: Deploying cephadm binary to smithi179 2024-09-17T09:09:39.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:39 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:39.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:39 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:39.962 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:39 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:40.323 INFO:teuthology.orchestra.run.smithi042.stdout:Added host 'smithi179' with addr '172.21.15.179' 2024-09-17T09:09:40.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:40 smithi042 ceph-mon[25899]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:40.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:40 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:40.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:40 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:40.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:40 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:40.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:40 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:41.093 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: Added host smithi179 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-17T09:09:41.826 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]': finished 2024-09-17T09:09:41.998 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:09:42.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:42 smithi042 ceph-mon[25899]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:09:42.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:42 smithi042 ceph-mon[25899]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:09:42.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:42 smithi042 ceph-mon[25899]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:09:42.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:42 smithi042 ceph-mon[25899]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:09:42.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:42 smithi042 ceph-mon[25899]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:43.930 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: Deploying daemon agent.smithi179 on smithi179 2024-09-17T09:09:43.930 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:43.930 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:43.930 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:43.930 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:43.930 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:43.930 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:43.931 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:43.931 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:43.931 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:43.931 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:43.931 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:43.931 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:44.355 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:09:44.356 INFO:teuthology.orchestra.run.smithi042.stdout:[{"addr": "172.21.15.42", "hostname": "smithi042", "labels": [], "status": ""}, {"addr": "172.21.15.161", "hostname": "smithi161", "labels": [], "status": ""}, {"addr": "172.21.15.179", "hostname": "smithi179", "labels": [], "status": ""}] 2024-09-17T09:09:44.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:44 smithi042 ceph-mon[25899]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:44.925 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:44 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:44.926 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:44 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:44.948 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-17T09:09:44.948 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-17T09:09:45.144 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:09:45.948 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:45 smithi042 ceph-mon[25899]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:09:45.948 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:45 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:46.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:46 smithi042 ceph-mon[25899]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:46.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:46.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:47.675 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-09-17T09:09:47.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:47 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1828210043' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T09:09:48.265 INFO:tasks.cephadm:Adding mon.a on smithi042 2024-09-17T09:09:48.266 INFO:tasks.cephadm:Adding mon.b on smithi161 2024-09-17T09:09:48.266 INFO:tasks.cephadm:Adding mon.c on smithi179 2024-09-17T09:09:48.266 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c' 2024-09-17T09:09:48.466 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:09:48.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:48 smithi042 ceph-mon[25899]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:48.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:48 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1828210043' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T09:09:48.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:48 smithi042 ceph-mon[25899]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:09:50.366 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled mon update... 2024-09-17T09:09:50.903 DEBUG:teuthology.orchestra.run.smithi161:mon.b> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.b.service 2024-09-17T09:09:50.906 DEBUG:teuthology.orchestra.run.smithi179:mon.c> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.c.service 2024-09-17T09:09:50.908 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T09:09:50.908 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T09:09:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:09:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:51.656 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:09:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:51 smithi042 ceph-mon[25899]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:51 smithi042 ceph-mon[25899]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c;count:3 2024-09-17T09:09:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:51 smithi042 ceph-mon[25899]: Deploying daemon mon.c on smithi179 2024-09-17T09:09:52.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:52 smithi042 ceph-mon[25899]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:54.256 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:09:54.257 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":1,"fsid":"3dd20088-74d4-11ef-bceb-c7b262605968","modified":"2024-09-17T09:08:12.285978Z","created":"2024-09-17T09:08:12.285978Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-17T09:09:54.257 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 1 2024-09-17T09:09:54.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:54 smithi042 ceph-mon[25899]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:54.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:09:54 smithi042 ceph-mon[25899]: from='client.? 172.21.15.179:0/3496958396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:09:55.926 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:55 smithi179 podman[27744]: 2024-09-17 09:09:55.715101014 +0000 UTC m=+0.015633727 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:09:56.235 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T09:09:56.236 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T09:09:56.429 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:09:56.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 podman[27744]: 2024-09-17 09:09:56.044261395 +0000 UTC m=+0.344794099 container init 2bdf791b79e39c7e9fcaab612578b472e3069b248bdde2b951f9bb64765ab0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, GIT_CLEAN=True) 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 podman[27744]: 2024-09-17 09:09:56.048716556 +0000 UTC m=+0.349249247 container start 2bdf791b79e39c7e9fcaab612578b472e3069b248bdde2b951f9bb64765ab0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 7 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pidfile_write: ignore empty --pid-file 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: load: jerasure load: lrc 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: RocksDB version: 7.9.2 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Git sha 0 2024-09-17T09:09:56.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: DB SUMMARY 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: DB Session ID: 5PVNSXJRLA2JO5B6OOYN 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: CURRENT file: CURRENT 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.error_if_exists: 0 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.create_if_missing: 0 2024-09-17T09:09:56.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.paranoid_checks: 1 2024-09-17T09:09:56.532 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T09:09:56.532 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T09:09:56.532 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T09:09:56.532 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.env: 0x55f0a5ee5bc0 2024-09-17T09:09:56.532 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T09:09:56.532 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.info_log: 0x55f0a7fa8be0 2024-09-17T09:09:56.532 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.statistics: (nil) 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.use_fsync: 0 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_log_file_size: 0 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T09:09:56.534 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.allow_fallocate: 1 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.use_direct_reads: 0 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.db_log_dir: 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.wal_dir: 2024-09-17T09:09:56.535 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.write_buffer_manager: 0x55f0a7fb6320 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T09:09:56.536 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.unordered_write: 0 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T09:09:56.537 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.row_cache: None 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.wal_filter: None 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.two_write_queues: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.wal_compression: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.atomic_flush: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.log_readahead_size: 0 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T09:09:56.538 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_background_jobs: 2 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_background_compactions: -1 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_subcompactions: 1 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T09:09:56.539 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_open_files: -1 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_background_flushes: -1 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Compression algorithms supported: 2024-09-17T09:09:56.540 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kZSTD supported: 0 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kXpressCompression supported: 0 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kBZip2Compression supported: 0 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kLZ4Compression supported: 1 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kZlibCompression supported: 1 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: kSnappyCompression supported: 1 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T09:09:56.541 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.merge_operator: 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_filter: None 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f0a7fa87e0) 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout: cache_index_and_filter_blocks: 1 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T09:09:56.542 INFO:journalctl@ceph.mon.c.smithi179.stdout: pin_top_level_index_and_filter: 1 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: index_type: 0 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: data_block_index_type: 0 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: index_shortening: 1 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: checksum: 4 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: no_block_cache: 0 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache: 0x55f0a7f9d350 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache_name: BinnedLRUCache 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache_options: 2024-09-17T09:09:56.543 INFO:journalctl@ceph.mon.c.smithi179.stdout: capacity : 536870912 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: num_shard_bits : 4 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: strict_capacity_limit : 0 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: high_pri_pool_ratio: 0.000 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_cache_compressed: (nil) 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: persistent_cache: (nil) 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_size: 4096 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_size_deviation: 10 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_restart_interval: 16 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: index_block_restart_interval: 1 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: metadata_block_size: 4096 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: partition_filters: 0 2024-09-17T09:09:56.544 INFO:journalctl@ceph.mon.c.smithi179.stdout: use_delta_encoding: 1 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: filter_policy: bloomfilter 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: whole_key_filtering: 1 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: verify_compression: 0 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: read_amp_bytes_per_bit: 0 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: format_version: 5 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: enable_index_compression: 1 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: block_align: 0 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: max_auto_readahead_size: 262144 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: prepopulate_block_cache: 0 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: initial_auto_readahead_size: 8192 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T09:09:56.545 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression: NoCompression 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.num_levels: 7 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T09:09:56.546 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T09:09:56.547 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T09:09:56.548 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T09:09:56.549 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T09:09:56.550 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.inplace_update_support: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.bloom_locality: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.max_successive_merges: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.ttl: 2592000 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T09:09:56.551 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.enable_blob_files: false 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.min_blob_size: 0 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T09:09:56.552 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca0ff54b-1705-45e9-b657-cb49703b1a5f 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564196075181, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564196075643, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726564196, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ca0ff54b-1705-45e9-b657-cb49703b1a5f", "db_session_id": "5PVNSXJRLA2JO5B6OOYN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564196075759, "job": 1, "event": "recovery_finished"} 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f0a7fc8e00 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: DB pointer 0x55f0a80bc000 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** DB Stats ** 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T09:09:56.553 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** Compaction Stats [default] ** 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-17T09:09:56.554 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** Compaction Stats [default] ** 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T09:09:56.555 INFO:journalctl@ceph.mon.c.smithi179.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout: Block cache BinnedLRUCache@0x55f0a7f9d350#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: using public_addr v2:172.21.15.179:0/0 -> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: starting mon.c rank -1 at public addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] at bind addrs [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(???) e0 preinit fsid 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).mds e1 new map 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-17T09:09:56.556 INFO:journalctl@ceph.mon.c.smithi179.stdout: e1 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout: legacy client fscid: -1 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout: 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout: No filesystems configured 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T09:09:56.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Deploying daemon agent.smithi161 on smithi161 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:56.558 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Deploying cephadm binary to smithi179 2024-09-17T09:09:56.559 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Added host smithi179 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:56.560 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]': finished 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:09:56.561 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Deploying daemon agent.smithi179 on smithi179 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:56.562 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1828210043' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1828210043' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T09:09:56.563 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c;count:3 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: Deploying daemon mon.c on smithi179 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.564 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:09:56.565 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: from='client.? 172.21.15.179:0/3496958396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:09:56.565 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 ceph-mon[27782]: mon.c@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-09-17T09:09:56.565 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 bash[27744]: 2bdf791b79e39c7e9fcaab612578b472e3069b248bdde2b951f9bb64765ab0f5 2024-09-17T09:09:56.565 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:09:56 smithi179 systemd[1]: Started Ceph mon.c for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:10:01.419 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: mon.a calling monitor election 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: mon.c calling monitor election 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.420 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: monmap e2: 2 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: fsmap 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: mgrmap e13: y(active, since 51s) 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: overall HEALTH_OK 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.421 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:01 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:01.448 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:10:01.448 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":2,"fsid":"3dd20088-74d4-11ef-bceb-c7b262605968","modified":"2024-09-17T09:09:56.100973Z","created":"2024-09-17T09:08:12.285978Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T09:10:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 2 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: mon.a calling monitor election 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: mon.c calling monitor election 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:01.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: monmap e2: 2 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: fsmap 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: mgrmap e13: y(active, since 51s) 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: overall HEALTH_OK 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.450 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:01.451 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:01.451 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:01 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:02.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:02 smithi042 ceph-mon[25899]: Deploying daemon mon.b on smithi161 2024-09-17T09:10:02.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:02 smithi042 ceph-mon[25899]: from='client.? 172.21.15.179:0/1973939124' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:10:02.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:02 smithi042 ceph-mon[25899]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:02.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:02 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:02.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:02 smithi179 ceph-mon[27782]: Deploying daemon mon.b on smithi161 2024-09-17T09:10:02.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:02 smithi179 ceph-mon[27782]: from='client.? 172.21.15.179:0/1973939124' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:10:02.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:02 smithi179 ceph-mon[27782]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:02.477 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:02 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:03.219 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-17T09:10:03.219 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-17T09:10:03.416 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:10:04.723 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:04 smithi179 ceph-mon[27782]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:04.924 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 podman[27640]: 2024-09-17 09:10:04.902342243 +0000 UTC m=+0.348313684 container start cf885518b748f9e1fd79405acaf956b09ab559b63c7eb4843bca9cd86c99238c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T09:10:04.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:04 smithi042 ceph-mon[25899]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: set uid:gid to 167:167 (ceph:ceph) 2024-09-17T09:10:05.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: ceph version 18.2.4-855-g19e2a2be (19e2a2beb6f41a3ab62650e38614eb29b59dcbb9) reef (stable), process ceph-mon, pid 7 2024-09-17T09:10:05.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pidfile_write: ignore empty --pid-file 2024-09-17T09:10:05.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: load: jerasure load: lrc 2024-09-17T09:10:05.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: RocksDB version: 7.9.2 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Git sha 0 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Compile date 2024-09-16 15:15:13 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: DB SUMMARY 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: DB Session ID: UP2JQSOGWXPGQW57BRR3 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: CURRENT file: CURRENT 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: IDENTITY file: IDENTITY 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.error_if_exists: 0 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.create_if_missing: 0 2024-09-17T09:10:05.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.paranoid_checks: 1 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.env: 0x560fbfc31bc0 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.fs: PosixFileSystem 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.info_log: 0x560fc0934be0 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_file_opening_threads: 16 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.statistics: (nil) 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.use_fsync: 0 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_log_file_size: 0 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-17T09:10:05.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.keep_log_file_num: 1000 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.recycle_log_file_num: 0 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.allow_fallocate: 1 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.allow_mmap_reads: 0 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.allow_mmap_writes: 0 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.use_direct_reads: 0 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.create_missing_column_families: 0 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.db_log_dir: 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.wal_dir: 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-17T09:10:05.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.advise_random_on_open: 1 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.db_write_buffer_size: 0 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.write_buffer_manager: 0x560fc0942320 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-17T09:10:05.273 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.rate_limiter: (nil) 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.wal_recovery_mode: 2 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.enable_thread_tracking: 0 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.enable_pipelined_write: 0 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.unordered_write: 0 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.row_cache: None 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.wal_filter: None 2024-09-17T09:10:05.274 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.allow_ingest_behind: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.two_write_queues: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.manual_wal_flush: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.wal_compression: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.atomic_flush: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.log_readahead_size: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.best_efforts_recovery: 0 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-17T09:10:05.275 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-17T09:10:05.276 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.allow_data_in_errors: 0 2024-09-17T09:10:05.276 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.db_host_id: __hostname__ 2024-09-17T09:10:05.276 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-17T09:10:05.277 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_background_jobs: 2 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_background_compactions: -1 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_subcompactions: 1 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_total_wal_size: 0 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_open_files: -1 2024-09-17T09:10:05.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bytes_per_sync: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_readahead_size: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_background_flushes: -1 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Compression algorithms supported: 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kZSTD supported: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kXpressCompression supported: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kBZip2Compression supported: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kLZ4Compression supported: 1 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kZlibCompression supported: 1 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kLZ4HCCompression supported: 1 2024-09-17T09:10:05.279 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: kSnappyCompression supported: 1 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.merge_operator: 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_filter: None 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_filter_factory: None 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.sst_partitioner_factory: None 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560fc09347e0) 2024-09-17T09:10:05.280 INFO:journalctl@ceph.mon.b.smithi161.stdout: cache_index_and_filter_blocks: 1 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: pin_top_level_index_and_filter: 1 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: index_type: 0 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: data_block_index_type: 0 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: index_shortening: 1 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: checksum: 4 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: no_block_cache: 0 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_cache: 0x560fc0929350 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_cache_name: BinnedLRUCache 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_cache_options: 2024-09-17T09:10:05.281 INFO:journalctl@ceph.mon.b.smithi161.stdout: capacity : 536870912 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: num_shard_bits : 4 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: strict_capacity_limit : 0 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: high_pri_pool_ratio: 0.000 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_cache_compressed: (nil) 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: persistent_cache: (nil) 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_size: 4096 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_size_deviation: 10 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_restart_interval: 16 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: index_block_restart_interval: 1 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: metadata_block_size: 4096 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: partition_filters: 0 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: use_delta_encoding: 1 2024-09-17T09:10:05.282 INFO:journalctl@ceph.mon.b.smithi161.stdout: filter_policy: bloomfilter 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: whole_key_filtering: 1 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: verify_compression: 0 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: read_amp_bytes_per_bit: 0 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: format_version: 5 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: enable_index_compression: 1 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: block_align: 0 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: max_auto_readahead_size: 262144 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: prepopulate_block_cache: 0 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: initial_auto_readahead_size: 8192 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout: num_file_reads_for_auto_readahead: 2 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.write_buffer_size: 33554432 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_write_buffer_number: 2 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression: NoCompression 2024-09-17T09:10:05.283 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression: Disabled 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.prefix_extractor: nullptr 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.num_levels: 7 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-17T09:10:05.284 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.level: 32767 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.strategy: 0 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-17T09:10:05.285 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.enabled: false 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.target_file_size_base: 67108864 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-17T09:10:05.286 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.arena_block_size: 1048576 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-17T09:10:05.287 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.disable_auto_compactions: 0 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-17T09:10:05.288 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.inplace_update_support: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.bloom_locality: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.max_successive_merges: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.paranoid_file_checks: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.force_consistency_checks: 1 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.report_bg_io_stats: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.ttl: 2592000 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-17T09:10:05.289 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.enable_blob_files: false 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.min_blob_size: 0 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.blob_file_size: 268435456 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.blob_file_starting_level: 0 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-17T09:10:05.290 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5e6ca5e2-1f31-4125-bc3d-11210c808e58 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564204929663, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564204930081, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726564204, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5e6ca5e2-1f31-4125-bc3d-11210c808e58", "db_session_id": "UP2JQSOGWXPGQW57BRR3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726564204930179, "job": 1, "event": "recovery_finished"} 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560fc0954e00 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: DB pointer 0x560fc0a48000 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout: ** DB Stats ** 2024-09-17T09:10:05.291 INFO:journalctl@ceph.mon.b.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: ** Compaction Stats [default] ** 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:10:05.292 INFO:journalctl@ceph.mon.b.smithi161.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: ** Compaction Stats [default] ** 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-17T09:10:05.293 INFO:journalctl@ceph.mon.b.smithi161.stdout: 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: Block cache BinnedLRUCache@0x560fc0929350#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: 2024-09-17T09:10:05.294 INFO:journalctl@ceph.mon.b.smithi161.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: using public_addr v2:172.21.15.161:0/0 -> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: starting mon.b rank -1 at public addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] at bind addrs [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(???) e0 preinit fsid 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).mds e1 new map 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout: e1 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout: legacy client fscid: -1 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout: 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout: No filesystems configured 2024-09-17T09:10:05.295 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Deploying daemon agent.smithi161 on smithi161 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.296 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.297 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi179", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Deploying cephadm binary to smithi179 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.298 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Added host smithi179 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]': finished 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:10:05.299 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Deploying daemon agent.smithi179 on smithi179 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:05.300 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1828210043' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1828210043' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-17T09:10:05.301 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Saving service mon spec with placement smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c;count:3 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Deploying daemon mon.c on smithi179 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.302 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.? 172.21.15.179:0/3496958396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.a calling monitor election 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.c calling monitor election 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: monmap e2: 2 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:05.303 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: fsmap 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mgrmap e13: y(active, since 51s) 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: overall HEALTH_OK 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:05.304 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: Deploying daemon mon.b on smithi161 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='client.? 172.21.15.179:0/1973939124' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:04 smithi161 ceph-mon[27677]: mon.b@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:05 smithi161 bash[27640]: cf885518b748f9e1fd79405acaf956b09ab559b63c7eb4843bca9cd86c99238c 2024-09-17T09:10:05.305 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:05 smithi161 systemd[1]: Started Ceph mon.b for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:10:10.257 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: mon.a calling monitor election 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: mon.c calling monitor election 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:10.258 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: monmap e3: 3 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],b=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: fsmap 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: mgrmap e13: y(active, since 60s) 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: mon.b (rank 2) addr [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] is down (out of quorum) 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.259 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.260 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.260 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.260 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-09-17T09:10:10.260 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":3,"fsid":"3dd20088-74d4-11ef-bceb-c7b262605968","modified":"2024-09-17T09:10:04.954645Z","created":"2024-09-17T09:08:12.285978Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:3300","nonce":0},{"type":"v1","addr":"172.21.15.42:6789","nonce":0}]},"addr":"172.21.15.42:6789/0","public_addr":"172.21.15.42:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-17T09:10:10.260 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 3 2024-09-17T09:10:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:10:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: mon.a calling monitor election 2024-09-17T09:10:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: mon.c calling monitor election 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: monmap e3: 3 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],b=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: fsmap 2024-09-17T09:10:10.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: mgrmap e13: y(active, since 60s) 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: mon.b (rank 2) addr [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] is down (out of quorum) 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.476 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:10.920 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-17T09:10:10.921 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-17T09:10:11.156 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:11.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:11.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:11.157 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-17T09:10:11.158 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-17T09:10:11.158 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:10:11.158 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='client.? 172.21.15.179:0/2969641076' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:10:11.158 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:11.158 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:11.158 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:11.159 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.159 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.159 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.159 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.159 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.159 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.160 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.160 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:11.160 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:11.160 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:11.160 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:11.160 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:11.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:11.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:11.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:11.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-17T09:10:11.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-17T09:10:11.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:10:11.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='client.? 172.21.15.179:0/2969641076' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:10:11.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:11.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:11.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:11.227 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:11.227 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:11.227 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:11.227 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.124 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:10:12.238 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:10:12.238 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.238 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: mon.a calling monitor election 2024-09-17T09:10:12.238 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: mon.c calling monitor election 2024-09-17T09:10:12.238 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: monmap e3: 3 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],b=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:12.239 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: fsmap 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: mgrmap e13: y(active, since 60s) 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: mon.b (rank 2) addr [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] is down (out of quorum) 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.240 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:10:12.241 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='client.? 172.21.15.179:0/2969641076' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:12.242 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:12.243 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:12.243 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:12.243 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:12.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: mon.b calling monitor election 2024-09-17T09:10:12.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: mon.b calling monitor election 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: mon.c calling monitor election 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: mon.a calling monitor election 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: monmap e3: 3 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],b=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: fsmap 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: mgrmap e13: y(active, since 62s) 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: Cluster is now healthy 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: overall HEALTH_OK 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:12.908 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:12.908 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:12 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:12.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: mon.b calling monitor election 2024-09-17T09:10:12.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: mon.b calling monitor election 2024-09-17T09:10:12.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: mon.c calling monitor election 2024-09-17T09:10:12.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: mon.a calling monitor election 2024-09-17T09:10:12.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: monmap e3: 3 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],b=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: fsmap 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: mgrmap e13: y(active, since 62s) 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: Cluster is now healthy 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: overall HEALTH_OK 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:12.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:12 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:13.020 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: mon.b calling monitor election 2024-09-17T09:10:13.020 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: mon.b calling monitor election 2024-09-17T09:10:13.020 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: mon.c calling monitor election 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: mon.a calling monitor election 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: monmap e3: 3 mons at {a=[v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0],b=[v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0],c=[v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: fsmap 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: osdmap e4: 0 total, 0 up, 0 in 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: mgrmap e13: y(active, since 62s) 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: Cluster is now healthy 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: overall HEALTH_OK 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:13.021 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:13.022 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:12 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:13.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:13 smithi042 ceph-mon[25899]: Reconfiguring mon.b (monmap changed)... 2024-09-17T09:10:13.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:13 smithi042 ceph-mon[25899]: Reconfiguring daemon mon.b on smithi161 2024-09-17T09:10:13.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:13.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:13.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:13.833 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:13.934 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:13 smithi161 ceph-mon[27677]: Reconfiguring mon.b (monmap changed)... 2024-09-17T09:10:13.934 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:13 smithi161 ceph-mon[27677]: Reconfiguring daemon mon.b on smithi161 2024-09-17T09:10:13.934 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:13 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:13.934 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:13 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:13.934 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:13 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:13.934 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:13 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:14.026 INFO:teuthology.orchestra.run.smithi042.stdout:# minimal ceph.conf for 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:10:14.026 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-09-17T09:10:14.026 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:10:14.026 INFO:teuthology.orchestra.run.smithi042.stdout: mon_host = [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-09-17T09:10:14.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:13 smithi179 ceph-mon[27782]: Reconfiguring mon.b (monmap changed)... 2024-09-17T09:10:14.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:13 smithi179 ceph-mon[27782]: Reconfiguring daemon mon.b on smithi161 2024-09-17T09:10:14.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:13 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:10:14.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:13 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:14.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:13 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:14.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:13 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:14.635 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-17T09:10:14.635 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:10:14.636 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T09:10:14.666 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:10:14.667 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:10:14.734 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:10:14.734 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T09:10:14.764 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:10:14.764 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:10:14.829 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:10:14.829 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.conf 2024-09-17T09:10:14.867 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:10:14.867 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:10:14.921 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:14 smithi161 ceph-mon[27677]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:14.921 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:14 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:14.921 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:14 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/2061742922' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:14.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:14 smithi179 ceph-mon[27782]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:14.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:14 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:14.933 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:14 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/2061742922' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:14.938 INFO:tasks.cephadm:Adding mgr.y on smithi042 2024-09-17T09:10:14.938 INFO:tasks.cephadm:Adding mgr.x on smithi161 2024-09-17T09:10:14.938 INFO:tasks.cephadm:Adding mgr.z on smithi179 2024-09-17T09:10:14.938 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi042=y;smithi161=x;smithi179=z' 2024-09-17T09:10:14.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:14 smithi042 ceph-mon[25899]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:14.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:14 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:14.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:14 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2061742922' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:15.173 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:10:15.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:15.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:15.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:15.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:15.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:15.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:15.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:15.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:15.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:16.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.019 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:16.020 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-17T09:10:16.020 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-17T09:10:16.020 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:16.824 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:16 smithi179 ceph-mon[27782]: Reconfiguring mon.c (monmap changed)... 2024-09-17T09:10:16.824 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:16 smithi179 ceph-mon[27782]: Reconfiguring daemon mon.c on smithi179 2024-09-17T09:10:16.824 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:16 smithi179 ceph-mon[27782]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:16.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:16 smithi042 ceph-mon[25899]: Reconfiguring mon.c (monmap changed)... 2024-09-17T09:10:16.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:16 smithi042 ceph-mon[25899]: Reconfiguring daemon mon.c on smithi179 2024-09-17T09:10:16.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:16 smithi042 ceph-mon[25899]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:17.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:16 smithi161 ceph-mon[27677]: Reconfiguring mon.c (monmap changed)... 2024-09-17T09:10:17.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:16 smithi161 ceph-mon[27677]: Reconfiguring daemon mon.c on smithi179 2024-09-17T09:10:17.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:16 smithi161 ceph-mon[27677]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:17.201 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled mgr update... 2024-09-17T09:10:18.318 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=y;smithi161=x;smithi179=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:18.318 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: Saving service mgr spec with placement smithi042=y;smithi161=x;smithi179=z;count:3 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T09:10:18.319 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:18.320 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:18.321 DEBUG:teuthology.orchestra.run.smithi161:mgr.x> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.x.service 2024-09-17T09:10:18.324 DEBUG:teuthology.orchestra.run.smithi179:mgr.z> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.z.service 2024-09-17T09:10:18.326 INFO:tasks.cephadm:Deploying OSDs... 2024-09-17T09:10:18.326 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:10:18.326 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:10:18.347 DEBUG:teuthology.misc:devs=['/dev/nvme4n1', '/dev/nvme3n1', '/dev/nvme2n1', '/dev/nvme1n1'] 2024-09-17T09:10:18.347 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/nvme4n1 2024-09-17T09:10:18.406 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/nvme4n1 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 1039 Links: 1 Device type: 103,8 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:10:01.927383151 +0000 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:15.517979073 +0000 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:15.517979073 +0000 2024-09-17T09:10:18.407 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:15.514979102 +0000 2024-09-17T09:10:18.407 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2024-09-17T09:10:18.473 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=y;smithi161=x;smithi179=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:18.473 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: Saving service mgr spec with placement smithi042=y;smithi161=x;smithi179=z;count:3 2024-09-17T09:10:18.473 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.473 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:18.473 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.473 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.473 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T09:10:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:18.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:10:18.476 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:10:18.476 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000145423 s, 3.5 MB/s 2024-09-17T09:10:18.477 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2024-09-17T09:10:18.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi042=y;smithi161=x;smithi179=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: Saving service mgr spec with placement smithi042=y;smithi161=x;smithi179=z;count:3 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:18.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:18.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:18.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T09:10:18.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:18.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:18.536 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/nvme3n1 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/nvme3n1 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 1028 Links: 1 Device type: 103,6 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:10:01.919383227 +0000 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:15.374980446 +0000 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:15.374980446 +0000 2024-09-17T09:10:18.594 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:15.371980474 +0000 2024-09-17T09:10:18.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2024-09-17T09:10:18.661 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:10:18.661 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:10:18.662 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000153174 s, 3.3 MB/s 2024-09-17T09:10:18.663 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2024-09-17T09:10:18.723 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/nvme2n1 2024-09-17T09:10:18.781 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/nvme2n1 2024-09-17T09:10:18.781 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:18.781 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 1015 Links: 1 Device type: 103,4 2024-09-17T09:10:18.781 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:18.782 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:18.782 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:10:01.911383302 +0000 2024-09-17T09:10:18.782 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:15.272981424 +0000 2024-09-17T09:10:18.782 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:15.272981424 +0000 2024-09-17T09:10:18.782 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:15.269981453 +0000 2024-09-17T09:10:18.782 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2024-09-17T09:10:18.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:10:18.848 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:10:18.848 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000143089 s, 3.6 MB/s 2024-09-17T09:10:18.849 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2024-09-17T09:10:18.908 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/nvme1n1 2024-09-17T09:10:18.965 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/nvme1n1 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 1004 Links: 1 Device type: 103,2 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-09-17 09:10:01.902383387 +0000 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-09-17 09:07:15.113982950 +0000 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-09-17 09:07:15.113982950 +0000 2024-09-17T09:10:18.966 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-09-17 09:07:15.110982979 +0000 2024-09-17T09:10:18.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2024-09-17T09:10:19.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-09-17T09:10:19.032 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-09-17T09:10:19.032 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000141179 s, 3.6 MB/s 2024-09-17T09:10:19.033 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2024-09-17T09:10:19.091 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:10:19.091 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:10:19.111 DEBUG:teuthology.misc:devs=['/dev/nvme4n1', '/dev/nvme3n1', '/dev/nvme2n1', '/dev/nvme1n1'] 2024-09-17T09:10:19.111 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/nvme4n1 2024-09-17T09:10:19.169 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/nvme4n1 2024-09-17T09:10:19.169 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:19.169 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 1039 Links: 1 Device type: 103,8 2024-09-17T09:10:19.169 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:19.170 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:19.170 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:10:12.884581729 +0000 2024-09-17T09:10:19.170 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:17.155512377 +0000 2024-09-17T09:10:19.170 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:17.155512377 +0000 2024-09-17T09:10:19.170 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:17.150512488 +0000 2024-09-17T09:10:19.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2024-09-17T09:10:19.237 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:10:19.237 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:10:19.237 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000243472 s, 2.1 MB/s 2024-09-17T09:10:19.238 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2024-09-17T09:10:19.296 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/nvme3n1 2024-09-17T09:10:19.304 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:19 smithi179 ceph-mon[27782]: Deploying daemon mgr.z on smithi179 2024-09-17T09:10:19.353 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/nvme3n1 2024-09-17T09:10:19.353 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:19.353 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 1028 Links: 1 Device type: 103,6 2024-09-17T09:10:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:10:12.873581974 +0000 2024-09-17T09:10:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:17.018515436 +0000 2024-09-17T09:10:19.354 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:17.018515436 +0000 2024-09-17T09:10:19.354 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:17.013515547 +0000 2024-09-17T09:10:19.354 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2024-09-17T09:10:19.419 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:10:19.420 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:10:19.420 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000216689 s, 2.4 MB/s 2024-09-17T09:10:19.421 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2024-09-17T09:10:19.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:19 smithi042 ceph-mon[25899]: Deploying daemon mgr.z on smithi179 2024-09-17T09:10:19.478 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/nvme2n1 2024-09-17T09:10:19.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:19 smithi161 ceph-mon[27677]: Deploying daemon mgr.z on smithi179 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/nvme2n1 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 1015 Links: 1 Device type: 103,4 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:10:12.863582197 +0000 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:16.872518695 +0000 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:16.872518695 +0000 2024-09-17T09:10:19.534 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:16.866518830 +0000 2024-09-17T09:10:19.535 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2024-09-17T09:10:19.599 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:10:19.599 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:10:19.599 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000219325 s, 2.3 MB/s 2024-09-17T09:10:19.600 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2024-09-17T09:10:19.657 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/nvme1n1 2024-09-17T09:10:19.712 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/nvme1n1 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 1004 Links: 1 Device type: 103,2 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-09-17 09:10:12.852582442 +0000 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-09-17 09:07:16.727521933 +0000 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-09-17 09:07:16.727521933 +0000 2024-09-17T09:10:19.713 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-09-17 09:07:16.722522045 +0000 2024-09-17T09:10:19.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2024-09-17T09:10:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-09-17T09:10:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-09-17T09:10:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000238236 s, 2.1 MB/s 2024-09-17T09:10:19.777 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2024-09-17T09:10:19.833 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:10:19.833 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T09:10:19.852 DEBUG:teuthology.misc:devs=['/dev/nvme4n1', '/dev/nvme3n1', '/dev/nvme2n1', '/dev/nvme1n1'] 2024-09-17T09:10:19.852 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/nvme4n1 2024-09-17T09:10:19.907 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/nvme4n1 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 1040 Links: 1 Device type: 103,8 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:10:12.713158724 +0000 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:18.793060481 +0000 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:18.793060481 +0000 2024-09-17T09:10:19.908 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:18.789060570 +0000 2024-09-17T09:10:19.908 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2024-09-17T09:10:19.966 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:19 smithi179 systemd[1]: Starting Ceph mgr.z for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:10:19.973 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:10:19.973 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:10:19.973 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000261352 s, 2.0 MB/s 2024-09-17T09:10:19.974 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2024-09-17T09:10:20.032 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/nvme3n1 2024-09-17T09:10:20.088 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/nvme3n1 2024-09-17T09:10:20.088 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:20.088 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 1027 Links: 1 Device type: 103,6 2024-09-17T09:10:20.088 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:20.088 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:20.089 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:10:12.703158950 +0000 2024-09-17T09:10:20.089 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:18.652063626 +0000 2024-09-17T09:10:20.089 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:18.652063626 +0000 2024-09-17T09:10:20.089 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:18.646063760 +0000 2024-09-17T09:10:20.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2024-09-17T09:10:20.153 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:10:20.153 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:10:20.153 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000198572 s, 2.6 MB/s 2024-09-17T09:10:20.154 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2024-09-17T09:10:20.210 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/nvme2n1 2024-09-17T09:10:20.217 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-mon[27782]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:20.217 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:19 smithi179 podman[30039]: 2024-09-17 09:10:19.868257349 +0000 UTC m=+0.015844739 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:10:20.217 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:19 smithi179 podman[30039]: 2024-09-17 09:10:19.993454646 +0000 UTC m=+0.141042016 container create a516ef5b2114e17ee33d78d70207d2e7f3141835830f897e1578e6542f0d6f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T09:10:20.218 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 podman[30039]: 2024-09-17 09:10:20.217459904 +0000 UTC m=+0.365047293 container init a516ef5b2114e17ee33d78d70207d2e7f3141835830f897e1578e6542f0d6f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T09:10:20.231 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/nvme2n1 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 1015 Links: 1 Device type: 103,4 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:10:12.693159177 +0000 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:18.508066838 +0000 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:18.508066838 +0000 2024-09-17T09:10:20.232 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:18.504066927 +0000 2024-09-17T09:10:20.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2024-09-17T09:10:20.295 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:10:20.295 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:10:20.296 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000203601 s, 2.5 MB/s 2024-09-17T09:10:20.297 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2024-09-17T09:10:20.354 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/nvme1n1 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/nvme1n1 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 1004 Links: 1 Device type: 103,2 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:fixed_disk_device_t:s0 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-09-17 09:10:12.683159403 +0000 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-09-17 09:07:18.362070094 +0000 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-09-17 09:07:18.362070094 +0000 2024-09-17T09:10:20.412 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: 2024-09-17 09:07:18.358070184 +0000 2024-09-17T09:10:20.413 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2024-09-17T09:10:20.473 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 podman[30039]: 2024-09-17 09:10:20.223308986 +0000 UTC m=+0.370896365 container start a516ef5b2114e17ee33d78d70207d2e7f3141835830f897e1578e6542f0d6f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T09:10:20.474 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-mgr[30192]: -- 172.21.15.179:0/1492528316 <== mon.1 v2:172.21.15.179:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561b6fafed00 con 0x561b6fad2800 2024-09-17T09:10:20.474 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 bash[30039]: a516ef5b2114e17ee33d78d70207d2e7f3141835830f897e1578e6542f0d6f37 2024-09-17T09:10:20.474 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 systemd[1]: Started Ceph mgr.z for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:10:20.474 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:20.345+0000 7fb1fb0f2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:10:20.474 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:20.408+0000 7fb1fb0f2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:10:20.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:20 smithi042 ceph-mon[25899]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:20.476 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-09-17T09:10:20.476 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-09-17T09:10:20.476 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000214206 s, 2.4 MB/s 2024-09-17T09:10:20.478 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2024-09-17T09:10:20.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:20 smithi161 ceph-mon[27677]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:20.533 INFO:tasks.cephadm:Deploying osd.0 on smithi042 with /dev/nvme1n1... 2024-09-17T09:10:20.534 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme1n1 2024-09-17T09:10:20.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:20.566+0000 7fb1fb0f2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:10:20.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:20.634+0000 7fb1fb0f2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:10:20.873 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:10:21.246 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:20.784+0000 7fb1fb0f2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:10:21.246 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:20.927+0000 7fb1fb0f2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:10:21.246 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:21.244+0000 7fb1fb0f2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:10:21.529 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:21.307+0000 7fb1fb0f2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:10:21.529 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:21.487+0000 7fb1fb0f2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:10:21.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:21.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T09:10:21.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:21.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:21.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: Deploying daemon mgr.x on smithi161 2024-09-17T09:10:21.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:21 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:21.716 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: Deploying daemon mgr.x on smithi161 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:21 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:21.717 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:21.718 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: Deploying daemon mgr.x on smithi161 2024-09-17T09:10:21.718 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.718 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:21.718 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:21 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:22.268 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 systemd[1]: Starting Ceph mgr.x for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:10:22.628 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:22 smithi042 ceph-mon[25899]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:22.654 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:22 smithi161 ceph-mon[27677]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:22.654 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 podman[29298]: 2024-09-17 09:10:22.301372115 +0000 UTC m=+0.015860493 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:10:22.654 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 podman[29298]: 2024-09-17 09:10:22.402173704 +0000 UTC m=+0.116662081 container create a7b5de7a3526aad1a26f672dab09a37d7e95c56bca9c32426a7bfd822dfb5181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-17T09:10:22.654 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 podman[29298]: 2024-09-17 09:10:22.654277977 +0000 UTC m=+0.368766354 container init a7b5de7a3526aad1a26f672dab09a37d7e95c56bca9c32426a7bfd822dfb5181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-17T09:10:22.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:22 smithi179 ceph-mon[27782]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:22.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:22 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:22.343+0000 7fb1fb0f2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:10:22.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:22 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:22.409+0000 7fb1fb0f2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:10:22.997 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 podman[29298]: 2024-09-17 09:10:22.658930945 +0000 UTC m=+0.373419322 container start a7b5de7a3526aad1a26f672dab09a37d7e95c56bca9c32426a7bfd822dfb5181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-17T09:10:22.997 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 ceph-mgr[29336]: -- 172.21.15.161:0/3669893002 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fe79abcd00 con 0x55fe79a91400 2024-09-17T09:10:22.997 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 bash[29298]: a7b5de7a3526aad1a26f672dab09a37d7e95c56bca9c32426a7bfd822dfb5181 2024-09-17T09:10:22.997 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 systemd[1]: Started Ceph mgr.x for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:10:22.997 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:22.780+0000 7fb055e5f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:10:22.997 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:22.841+0000 7fb055e5f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:10:22.997 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:22 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:22.995+0000 7fb055e5f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:10:23.268 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:23.062+0000 7fb055e5f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:10:23.268 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:23.206+0000 7fb055e5f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:10:23.443 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.132+0000 7fb1fb0f2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:10:23.444 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.244+0000 7fb1fb0f2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:10:23.444 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.382+0000 7fb1fb0f2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:10:23.444 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.442+0000 7fb1fb0f2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:10:23.650 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:23.344+0000 7fb055e5f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:10:23.650 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:23.649+0000 7fb055e5f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:10:23.713 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.587+0000 7fb1fb0f2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:10:23.713 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.653+0000 7fb1fb0f2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:10:23.713 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.711+0000 7fb1fb0f2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:10:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping: /dev/nvme1n1 2024-09-17T09:10:23.790 INFO:teuthology.orchestra.run.smithi042.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-17T09:10:23.795 INFO:teuthology.orchestra.run.smithi042.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=10 conv=fsync 2024-09-17T09:10:23.808 INFO:teuthology.orchestra.run.smithi042.stderr: stderr: 10+0 records in 2024-09-17T09:10:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:10+0 records out 2024-09-17T09:10:23.808 INFO:teuthology.orchestra.run.smithi042.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112465 s, 932 MB/s 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: Reconfiguring mgr.y (unknown last config time)... 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:23.809 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:23.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:23.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: Reconfiguring daemon mgr.y on smithi042 2024-09-17T09:10:23.810 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:23 smithi042 ceph-mon[25899]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:23.810 INFO:teuthology.orchestra.run.smithi042.stderr:--> Zapping successful for: 2024-09-17T09:10:23.905 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: Reconfiguring mgr.y (unknown last config time)... 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:23.906 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: Reconfiguring daemon mgr.y on smithi042 2024-09-17T09:10:23.907 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-mon[27677]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:23.907 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:23.709+0000 7fb055e5f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:10:23.996 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.866+0000 7fb1fb0f2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:10:23.996 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.930+0000 7fb1fb0f2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:23.995+0000 7fb1fb0f2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:23.997 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: Reconfiguring mgr.y (unknown last config time)... 2024-09-17T09:10:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-17T09:10:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-17T09:10:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: Reconfiguring daemon mgr.y on smithi042 2024-09-17T09:10:23.998 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:23 smithi179 ceph-mon[27782]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:24.157 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:23 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:23.904+0000 7fb055e5f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:10:24.279 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:24 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:24.076+0000 7fb1fb0f2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:10:24.279 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:24 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:24.134+0000 7fb1fb0f2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:10:24.279 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:24 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:24.191+0000 7fb1fb0f2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:10:24.477 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi042:/dev/nvme1n1 2024-09-17T09:10:25.133 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:10:24.998+0000 7fb1fb0f2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:10:25.178 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:24 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:24.856+0000 7fb055e5f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:10:25.178 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:24 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:24.935+0000 7fb055e5f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:10:25.374 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:10:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: Standby manager daemon z started 2024-09-17T09:10:25.751 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:25.752 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: Standby manager daemon z started 2024-09-17T09:10:25.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-17T09:10:25.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:10:25.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-17T09:10:25.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:10:25.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.976 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:25.976 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:25.976 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:25.976 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.999 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:25.999 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: Standby manager daemon z started 2024-09-17T09:10:25.999 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-17T09:10:26.000 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:10:26.000 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-17T09:10:26.000 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2611374058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:10:26.000 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:26.000 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:26.000 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:26.001 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:26.001 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:26.001 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:26.001 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:25.718+0000 7fb055e5f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:10:26.001 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:25.842+0000 7fb055e5f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:10:26.269 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:25 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:25.997+0000 7fb055e5f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:10:26.269 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.059+0000 7fb055e5f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:10:26.269 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.207+0000 7fb055e5f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:10:26.567 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.275+0000 7fb055e5f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:10:26.567 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.336+0000 7fb055e5f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:10:26.567 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.500+0000 7fb055e5f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:10:26.568 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.566+0000 7fb055e5f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:10:26.837 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-mon[27677]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:26.837 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-mon[27677]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:26.837 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-mon[27677]: mgrmap e14: y(active, since 76s), standbys: z 2024-09-17T09:10:26.837 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-17T09:10:26.837 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:26.838 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.633+0000 7fb055e5f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:10:26.838 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.718+0000 7fb055e5f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:10:26.838 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.777+0000 7fb055e5f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:10:26.838 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:26.836+0000 7fb055e5f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:10:26.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:26 smithi042 ceph-mon[25899]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:26.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:26 smithi042 ceph-mon[25899]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:26.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:26 smithi042 ceph-mon[25899]: mgrmap e14: y(active, since 76s), standbys: z 2024-09-17T09:10:26.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-17T09:10:26.873 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:26 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:26.939 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:26 smithi179 ceph-mon[27782]: Metadata not up to date on all hosts. Skipping non agent specs 2024-09-17T09:10:26.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:26 smithi179 ceph-mon[27782]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:26.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:26 smithi179 ceph-mon[27782]: mgrmap e14: y(active, since 76s), standbys: z 2024-09-17T09:10:26.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:26 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-17T09:10:26.940 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:26 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.018 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:10:27 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:10:27.625+0000 7fb055e5f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:10:28.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:28.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: Standby manager daemon x started 2024-09-17T09:10:28.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T09:10:28.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:10:28.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T09:10:28.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:10:28.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:28 smithi042 ceph-mon[25899]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:28.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: Standby manager daemon x started 2024-09-17T09:10:28.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T09:10:28.281 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:10:28.281 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T09:10:28.281 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:10:28.281 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:28 smithi179 ceph-mon[27782]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:28.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi042:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: Standby manager daemon x started 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/564322132' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:10:28.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:28 smithi161 ceph-mon[27677]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:29.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:29 smithi042 ceph-mon[25899]: mgrmap e15: y(active, since 78s), standbys: z, x 2024-09-17T09:10:29.644 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:29 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T09:10:29.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:29 smithi161 ceph-mon[27677]: mgrmap e15: y(active, since 78s), standbys: z, x 2024-09-17T09:10:29.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:29 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T09:10:29.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:29 smithi179 ceph-mon[27782]: mgrmap e15: y(active, since 78s), standbys: z, x 2024-09-17T09:10:29.781 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:29 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T09:10:30.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:30 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1889896660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "684fe44c-84df-450d-89af-befb1a2bffe2"}]: dispatch 2024-09-17T09:10:30.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:30 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1889896660' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "684fe44c-84df-450d-89af-befb1a2bffe2"}]': finished 2024-09-17T09:10:30.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:30 smithi042 ceph-mon[25899]: osdmap e5: 1 total, 0 up, 1 in 2024-09-17T09:10:30.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:30 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:30.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:30 smithi042 ceph-mon[25899]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:30.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:30 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1889896660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "684fe44c-84df-450d-89af-befb1a2bffe2"}]: dispatch 2024-09-17T09:10:30.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:30 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1889896660' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "684fe44c-84df-450d-89af-befb1a2bffe2"}]': finished 2024-09-17T09:10:30.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:30 smithi179 ceph-mon[27782]: osdmap e5: 1 total, 0 up, 1 in 2024-09-17T09:10:30.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:30 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:30.762 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:30 smithi179 ceph-mon[27782]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:30.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:30 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1889896660' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "684fe44c-84df-450d-89af-befb1a2bffe2"}]: dispatch 2024-09-17T09:10:30.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:30 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1889896660' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "684fe44c-84df-450d-89af-befb1a2bffe2"}]': finished 2024-09-17T09:10:30.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:30 smithi161 ceph-mon[27677]: osdmap e5: 1 total, 0 up, 1 in 2024-09-17T09:10:30.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:30 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:30.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:30 smithi161 ceph-mon[27677]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:31.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:31 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1915576997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:10:32.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:31 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1915576997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:10:32.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:31 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1915576997' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:10:32.936 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:32 smithi042 ceph-mon[25899]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:33.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:32 smithi161 ceph-mon[27677]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:33.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:32 smithi179 ceph-mon[27782]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:34.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:34 smithi042 ceph-mon[25899]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:35.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:34 smithi161 ceph-mon[27677]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:35.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:34 smithi179 ceph-mon[27782]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:36.742 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:36 smithi042 ceph-mon[25899]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:36.742 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:36 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T09:10:36.742 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:36 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:37.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:36 smithi161 ceph-mon[27677]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:37.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:36 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T09:10:37.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:36 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:37.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:36 smithi179 ceph-mon[27782]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:37.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:36 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-17T09:10:37.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:36 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:37.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:37 smithi042 ceph-mon[25899]: Deploying daemon osd.0 on smithi042 2024-09-17T09:10:38.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:37 smithi161 ceph-mon[27677]: Deploying daemon osd.0 on smithi042 2024-09-17T09:10:38.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:37 smithi179 ceph-mon[27782]: Deploying daemon osd.0 on smithi042 2024-09-17T09:10:38.768 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:38 smithi042 ceph-mon[25899]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:39.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:38 smithi161 ceph-mon[27677]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:39.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:38 smithi179 ceph-mon[27782]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:40.969 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:40 smithi042 ceph-mon[25899]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:41.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:40 smithi161 ceph-mon[27677]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:41.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:40 smithi179 ceph-mon[27782]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:42.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:42 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:42 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:42 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:42 smithi042 ceph-mon[25899]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:42.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:42 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:42 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:42 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:42 smithi161 ceph-mon[27677]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:42.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:42 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:42 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:42 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:42.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:42 smithi179 ceph-mon[27782]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:43.578 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:43.578 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.579 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:43.579 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:43.579 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.579 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:43.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:43.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:43.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:43.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:43.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:43.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:43.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:44.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:44 smithi042 ceph-mon[25899]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:44.730 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:44 smithi161 ceph-mon[27677]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:44.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:44 smithi179 ceph-mon[27782]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:46.250 INFO:teuthology.orchestra.run.smithi042.stdout:Created osd(s) 0 on host 'smithi042' 2024-09-17T09:10:46.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:46 smithi179 ceph-mon[27782]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:46.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:46 smithi179 ceph-mon[27782]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T09:10:46.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:46 smithi042 ceph-mon[25899]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:46.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:46 smithi042 ceph-mon[25899]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T09:10:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:46 smithi161 ceph-mon[27677]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:46.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:46 smithi161 ceph-mon[27677]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-17T09:10:46.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:46.892 DEBUG:teuthology.orchestra.run.smithi042:osd.0> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.0.service 2024-09-17T09:10:46.894 INFO:tasks.cephadm:Deploying osd.1 on smithi161 with /dev/nvme1n1... 2024-09-17T09:10:46.895 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme1n1 2024-09-17T09:10:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T09:10:47.412 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: Adjusting osd_memory_target on smithi042 to 16068M 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.413 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:47.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:47.414 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.475 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: Adjusting osd_memory_target on smithi042 to 16068M 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:47.476 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:47.477 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-17T09:10:47.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: osdmap e6: 1 total, 0 up, 1 in 2024-09-17T09:10:47.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:47.531 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]: dispatch 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: Adjusting osd_memory_target on smithi042 to 16068M 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:10:47.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:47.974 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0[37910]: 2024-09-17T09:10:47.529+0000 7fd3e356f640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T09:10:47.974 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:10:47 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0[37910]: 2024-09-17T09:10:47.531+0000 7fd3dab79640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T09:10:48.449 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:48 smithi161 ceph-mon[27677]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-17T09:10:48.450 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:48 smithi161 ceph-mon[27677]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T09:10:48.450 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:48 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:48.450 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:48 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:48.450 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:48 smithi161 ceph-mon[27677]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' 2024-09-17T09:10:48.450 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:48 smithi161 ceph-mon[27677]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:48.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:48 smithi179 ceph-mon[27782]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-17T09:10:48.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:48 smithi179 ceph-mon[27782]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T09:10:48.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:48 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:48.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:48 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:48.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:48 smithi179 ceph-mon[27782]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' 2024-09-17T09:10:48.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:48 smithi179 ceph-mon[27782]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:48.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:48 smithi042 ceph-mon[25899]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi042", "root=default"]}]': finished 2024-09-17T09:10:48.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:48 smithi042 ceph-mon[25899]: osdmap e7: 1 total, 0 up, 1 in 2024-09-17T09:10:48.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:48 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:48.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:48 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:48.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:48 smithi042 ceph-mon[25899]: from='osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953]' entity='osd.0' 2024-09-17T09:10:48.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:48 smithi042 ceph-mon[25899]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-17T09:10:48.862 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping: /dev/nvme1n1 2024-09-17T09:10:48.862 INFO:teuthology.orchestra.run.smithi161.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-17T09:10:48.866 INFO:teuthology.orchestra.run.smithi161.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=10 conv=fsync 2024-09-17T09:10:48.882 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10+0 records in 2024-09-17T09:10:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:10+0 records out 2024-09-17T09:10:48.882 INFO:teuthology.orchestra.run.smithi161.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125319 s, 837 MB/s 2024-09-17T09:10:48.882 INFO:teuthology.orchestra.run.smithi161.stderr:--> Zapping successful for: 2024-09-17T09:10:49.468 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:49 smithi161 ceph-mon[27677]: purged_snaps scrub starts 2024-09-17T09:10:49.468 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:49 smithi161 ceph-mon[27677]: purged_snaps scrub ok 2024-09-17T09:10:49.468 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:49 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:49.468 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:49 smithi161 ceph-mon[27677]: osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953] boot 2024-09-17T09:10:49.468 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:49 smithi161 ceph-mon[27677]: osdmap e8: 1 total, 1 up, 1 in 2024-09-17T09:10:49.468 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:49 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:49.489 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi161:/dev/nvme1n1 2024-09-17T09:10:49.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:49 smithi179 ceph-mon[27782]: purged_snaps scrub starts 2024-09-17T09:10:49.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:49 smithi179 ceph-mon[27782]: purged_snaps scrub ok 2024-09-17T09:10:49.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:49 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:49.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:49 smithi179 ceph-mon[27782]: osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953] boot 2024-09-17T09:10:49.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:49 smithi179 ceph-mon[27782]: osdmap e8: 1 total, 1 up, 1 in 2024-09-17T09:10:49.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:49 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T09:10:49.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:49 smithi042 ceph-mon[25899]: purged_snaps scrub starts 2024-09-17T09:10:49.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:49 smithi042 ceph-mon[25899]: purged_snaps scrub ok 2024-09-17T09:10:49.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:49 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:49.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:49 smithi042 ceph-mon[25899]: osd.0 [v2:172.21.15.42:6802/2756799953,v1:172.21.15.42:6803/2756799953] boot 2024-09-17T09:10:49.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:49 smithi042 ceph-mon[25899]: osdmap e8: 1 total, 1 up, 1 in 2024-09-17T09:10:49.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:49 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:10:50.782 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:50 smithi161 ceph-mon[27677]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T09:10:50.782 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:50 smithi161 ceph-mon[27677]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:50 smithi042 ceph-mon[25899]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T09:10:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:50 smithi042 ceph-mon[25899]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:51.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:50 smithi179 ceph-mon[27782]: osdmap e9: 1 total, 1 up, 1 in 2024-09-17T09:10:51.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:50 smithi179 ceph-mon[27782]: pgmap v49: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:51.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:51 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:10:51.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:51 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:10:51.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:51 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:51.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:51 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:10:51.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:51 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:10:51.844 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:51 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:51.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:51 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:10:51.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:51 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:10:51.881 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:51 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:10:52.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:52 smithi161 ceph-mon[27677]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:52.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:52 smithi161 ceph-mon[27677]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:52.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:52 smithi042 ceph-mon[25899]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:52.865 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:52 smithi042 ceph-mon[25899]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:53.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:52 smithi179 ceph-mon[27782]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi161:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:10:53.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:52 smithi179 ceph-mon[27782]: pgmap v50: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:54.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:54 smithi042 ceph-mon[25899]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:54.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:54 smithi042 ceph-mon[25899]: from='client.? 172.21.15.161:0/926226932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]: dispatch 2024-09-17T09:10:54.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:54 smithi042 ceph-mon[25899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]: dispatch 2024-09-17T09:10:54.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:54 smithi042 ceph-mon[25899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]': finished 2024-09-17T09:10:54.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:54 smithi042 ceph-mon[25899]: osdmap e10: 2 total, 1 up, 2 in 2024-09-17T09:10:54.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:54 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:10:55.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:54 smithi161 ceph-mon[27677]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:55.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:54 smithi161 ceph-mon[27677]: from='client.? 172.21.15.161:0/926226932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]: dispatch 2024-09-17T09:10:55.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:54 smithi161 ceph-mon[27677]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]: dispatch 2024-09-17T09:10:55.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:54 smithi161 ceph-mon[27677]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]': finished 2024-09-17T09:10:55.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:54 smithi161 ceph-mon[27677]: osdmap e10: 2 total, 1 up, 2 in 2024-09-17T09:10:55.013 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:54 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:10:55.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:54 smithi179 ceph-mon[27782]: pgmap v51: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:55.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:54 smithi179 ceph-mon[27782]: from='client.? 172.21.15.161:0/926226932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]: dispatch 2024-09-17T09:10:55.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:54 smithi179 ceph-mon[27782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]: dispatch 2024-09-17T09:10:55.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:54 smithi179 ceph-mon[27782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc71e050-4540-485d-8d4b-0ddd804e106d"}]': finished 2024-09-17T09:10:55.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:54 smithi179 ceph-mon[27782]: osdmap e10: 2 total, 1 up, 2 in 2024-09-17T09:10:55.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:54 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:10:55.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:55 smithi042 ceph-mon[25899]: from='client.? 172.21.15.161:0/4219046884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:10:56.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:55 smithi161 ceph-mon[27677]: from='client.? 172.21.15.161:0/4219046884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:10:56.028 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:55 smithi179 ceph-mon[27782]: from='client.? 172.21.15.161:0/4219046884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:10:56.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:56 smithi042 ceph-mon[25899]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:57.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:56 smithi161 ceph-mon[27677]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:57.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:56 smithi179 ceph-mon[27782]: pgmap v53: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:58.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:58 smithi042 ceph-mon[25899]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:58.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:58 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:58.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:58 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:58.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:58 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:59.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:58 smithi161 ceph-mon[27677]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:59.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:58 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:59.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:58 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:59.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:58 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:59.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:58 smithi179 ceph-mon[27782]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:10:59.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:58 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:59.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:58 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:59.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:58 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:10:59.927 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:10:59 smithi161 ceph-mon[27677]: Detected new or changed devices on smithi042 2024-09-17T09:10:59.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:10:59 smithi042 ceph-mon[25899]: Detected new or changed devices on smithi042 2024-09-17T09:11:00.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:10:59 smithi179 ceph-mon[27782]: Detected new or changed devices on smithi042 2024-09-17T09:11:00.924 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:00 smithi161 ceph-mon[27677]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:00.924 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:00 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T09:11:00.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:00 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:00.925 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:00 smithi161 ceph-mon[27677]: Deploying daemon osd.1 on smithi161 2024-09-17T09:11:00.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:00 smithi042 ceph-mon[25899]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:00.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:00 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T09:11:00.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:00 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:00.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:00 smithi042 ceph-mon[25899]: Deploying daemon osd.1 on smithi161 2024-09-17T09:11:01.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:00 smithi179 ceph-mon[27782]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:01.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:00 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-17T09:11:01.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:00 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:01.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:00 smithi179 ceph-mon[27782]: Deploying daemon osd.1 on smithi161 2024-09-17T09:11:01.910 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:01 smithi161 ceph-mon[27677]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:01.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:01 smithi042 ceph-mon[25899]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:02.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:01 smithi179 ceph-mon[27782]: pgmap v56: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:04.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:04 smithi161 ceph-mon[27677]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:04.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:04 smithi042 ceph-mon[25899]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:05.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:04 smithi179 ceph-mon[27782]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:06.360 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:06 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.360 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:06 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.360 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:06 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.360 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:06 smithi179 ceph-mon[27782]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:06.624 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:06 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.624 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:06 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.624 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:06 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.624 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:06 smithi161 ceph-mon[27677]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:06 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:06 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:06 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:06 smithi042 ceph-mon[25899]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:07.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.447 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.448 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:07.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:07.449 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:07 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:07.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:07.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:07 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:07.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:07.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:07 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:08.565 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:08 smithi161 ceph-mon[27677]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.565 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:08 smithi161 ceph-mon[27677]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.565 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:08 smithi161 ceph-mon[27677]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.565 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:08 smithi161 ceph-mon[27677]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T09:11:08.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:08 smithi042 ceph-mon[25899]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:08 smithi042 ceph-mon[25899]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:08 smithi042 ceph-mon[25899]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:08 smithi042 ceph-mon[25899]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T09:11:08.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:08 smithi179 ceph-mon[27782]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:08 smithi179 ceph-mon[27782]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:08 smithi179 ceph-mon[27782]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:08.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:08 smithi179 ceph-mon[27782]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-09-17T09:11:10.489 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:10 smithi161 ceph-mon[27677]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:10.489 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:10 smithi161 ceph-mon[27677]: from='osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T09:11:10.489 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:10 smithi161 ceph-mon[27677]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T09:11:10.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:10 smithi042 ceph-mon[25899]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:10.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:10 smithi042 ceph-mon[25899]: from='osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T09:11:10.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:10 smithi042 ceph-mon[25899]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T09:11:10.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:10 smithi179 ceph-mon[27782]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:10.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:10 smithi179 ceph-mon[27782]: from='osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T09:11:10.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:10 smithi179 ceph-mon[27782]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-17T09:11:10.789 INFO:teuthology.orchestra.run.smithi161.stdout:Created osd(s) 1 on host 'smithi161' 2024-09-17T09:11:11.386 DEBUG:teuthology.orchestra.run.smithi161:osd.1> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.1.service 2024-09-17T09:11:11.388 INFO:tasks.cephadm:Deploying osd.2 on smithi179 with /dev/nvme1n1... 2024-09-17T09:11:11.388 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/nvme1n1 2024-09-17T09:11:11.591 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:11:11.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T09:11:11.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T09:11:11.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:11.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-17T09:11:11.711 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:11.712 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:11 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:11:11.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:11.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:11.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:11 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-17T09:11:11.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: osdmap e11: 2 total, 1 up, 2 in 2024-09-17T09:11:11.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:11.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]: dispatch 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:11.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:12.269 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1[32985]: 2024-09-17T09:11:11.819+0000 7f9ac4dd2640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T09:11:12.269 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:11 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1[32985]: 2024-09-17T09:11:11.823+0000 7f9abcbf3640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: Adjusting osd_memory_target on smithi161 to 16064M 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: pgmap v65: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:12.653 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:12 smithi179 ceph-mon[27782]: from='osd.1 ' entity='osd.1' 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: Adjusting osd_memory_target on smithi161 to 16064M 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: pgmap v65: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:12.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:12 smithi042 ceph-mon[25899]: from='osd.1 ' entity='osd.1' 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: Adjusting osd_memory_target on smithi161 to 16064M 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: pgmap v65: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi161", "root=default"]}]': finished 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: osdmap e12: 2 total, 1 up, 2 in 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:12.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:12 smithi161 ceph-mon[27677]: from='osd.1 ' entity='osd.1' 2024-09-17T09:11:13.380 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping: /dev/nvme1n1 2024-09-17T09:11:13.380 INFO:teuthology.orchestra.run.smithi179.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2024-09-17T09:11:13.383 INFO:teuthology.orchestra.run.smithi179.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=10 conv=fsync 2024-09-17T09:11:13.400 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10+0 records in 2024-09-17T09:11:13.400 INFO:teuthology.orchestra.run.smithi179.stderr:10+0 records out 2024-09-17T09:11:13.400 INFO:teuthology.orchestra.run.smithi179.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.014359 s, 730 MB/s 2024-09-17T09:11:13.400 INFO:teuthology.orchestra.run.smithi179.stderr:--> Zapping successful for: 2024-09-17T09:11:13.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:13 smithi179 ceph-mon[27782]: purged_snaps scrub starts 2024-09-17T09:11:13.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:13 smithi179 ceph-mon[27782]: purged_snaps scrub ok 2024-09-17T09:11:13.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:13 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:13.709 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:13 smithi179 ceph-mon[27782]: osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620] boot 2024-09-17T09:11:13.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:13 smithi179 ceph-mon[27782]: osdmap e13: 2 total, 2 up, 2 in 2024-09-17T09:11:13.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:13 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:13.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:13 smithi042 ceph-mon[25899]: purged_snaps scrub starts 2024-09-17T09:11:13.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:13 smithi042 ceph-mon[25899]: purged_snaps scrub ok 2024-09-17T09:11:13.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:13.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:13 smithi042 ceph-mon[25899]: osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620] boot 2024-09-17T09:11:13.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:13 smithi042 ceph-mon[25899]: osdmap e13: 2 total, 2 up, 2 in 2024-09-17T09:11:13.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:13 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:13.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:13 smithi161 ceph-mon[27677]: purged_snaps scrub starts 2024-09-17T09:11:13.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:13 smithi161 ceph-mon[27677]: purged_snaps scrub ok 2024-09-17T09:11:13.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:13 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:13.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:13 smithi161 ceph-mon[27677]: osd.1 [v2:172.21.15.161:6800/1794465620,v1:172.21.15.161:6801/1794465620] boot 2024-09-17T09:11:13.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:13 smithi161 ceph-mon[27677]: osdmap e13: 2 total, 2 up, 2 in 2024-09-17T09:11:13.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:13 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:11:13.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi179:/dev/nvme1n1 2024-09-17T09:11:14.154 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:11:14.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:14 smithi179 ceph-mon[27782]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:14.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:14 smithi179 ceph-mon[27782]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T09:11:14.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:14 smithi042 ceph-mon[25899]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:14.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:14 smithi042 ceph-mon[25899]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T09:11:14.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:14 smithi161 ceph-mon[27677]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-17T09:11:14.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:14 smithi161 ceph-mon[27677]: osdmap e14: 2 total, 2 up, 2 in 2024-09-17T09:11:16.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:16 smithi179 ceph-mon[27782]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:16.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:16 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:11:16.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:16 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:11:16.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:16 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:16.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:16 smithi042 ceph-mon[25899]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:16.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:16 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:11:16.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:16 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:11:16.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:16 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:16.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:16 smithi161 ceph-mon[27677]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:16.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:16 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-17T09:11:16.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:16 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-17T09:11:16.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:16 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:17.473 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:17 smithi179 ceph-mon[27782]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:17.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:17 smithi042 ceph-mon[25899]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:17.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:17 smithi161 ceph-mon[27677]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi179:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:18.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:18.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='client.? 172.21.15.179:0/3164562863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]: dispatch 2024-09-17T09:11:18.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]: dispatch 2024-09-17T09:11:18.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]': finished 2024-09-17T09:11:18.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: osdmap e15: 3 total, 2 up, 3 in 2024-09-17T09:11:18.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:18 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:18.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:18.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='client.? 172.21.15.179:0/3164562863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]: dispatch 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]: dispatch 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]': finished 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: osdmap e15: 3 total, 2 up, 3 in 2024-09-17T09:11:18.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:18 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:18.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:18.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='client.? 172.21.15.179:0/3164562863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]: dispatch 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]: dispatch 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69b94f3d-842c-464e-af5a-36fdbc243f67"}]': finished 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: osdmap e15: 3 total, 2 up, 3 in 2024-09-17T09:11:18.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:18 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:19.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:19 smithi042 ceph-mon[25899]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:19 smithi042 ceph-mon[25899]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:19 smithi042 ceph-mon[25899]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:19 smithi042 ceph-mon[25899]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:19 smithi161 ceph-mon[27677]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:19 smithi161 ceph-mon[27677]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:19 smithi161 ceph-mon[27677]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:19 smithi161 ceph-mon[27677]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:19 smithi179 ceph-mon[27782]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:19 smithi179 ceph-mon[27782]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:19 smithi179 ceph-mon[27782]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:19.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:19 smithi179 ceph-mon[27782]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:20.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:20 smithi042 ceph-mon[25899]: from='client.? 172.21.15.179:0/3517105097' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:11:20.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:20 smithi161 ceph-mon[27677]: from='client.? 172.21.15.179:0/3517105097' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:11:20.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:20 smithi179 ceph-mon[27782]: from='client.? 172.21.15.179:0/3517105097' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-17T09:11:21.634 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:21 smithi042 ceph-mon[25899]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:21.642 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:21 smithi179 ceph-mon[27782]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:21.669 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:21 smithi161 ceph-mon[27677]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:23.557 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:23 smithi179 ceph-mon[27782]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:23.665 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:23 smithi042 ceph-mon[25899]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:23.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:23 smithi161 ceph-mon[27677]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:25.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:25 smithi161 ceph-mon[27677]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:25.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T09:11:25.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:25 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:25.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:25 smithi161 ceph-mon[27677]: Deploying daemon osd.2 on smithi179 2024-09-17T09:11:25.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:25 smithi179 ceph-mon[27782]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:25.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T09:11:25.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:25 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:25.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:25 smithi179 ceph-mon[27782]: Deploying daemon osd.2 on smithi179 2024-09-17T09:11:25.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:25 smithi042 ceph-mon[25899]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:25.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-17T09:11:25.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:25 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:25.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:25 smithi042 ceph-mon[25899]: Deploying daemon osd.2 on smithi179 2024-09-17T09:11:27.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:27.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:27 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.756 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:27.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:27.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:27.757 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:27 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.766 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:27.767 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:27 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:28.624 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:28 smithi179 ceph-mon[27782]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:28.624 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:28 smithi179 ceph-mon[27782]: Detected new or changed devices on smithi161 2024-09-17T09:11:28.625 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:28 smithi179 ceph-mon[27782]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T09:11:28.625 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:28 smithi179 ceph-mon[27782]: Cluster is now healthy 2024-09-17T09:11:28.672 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:28 smithi161 ceph-mon[27677]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:28.673 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:28 smithi161 ceph-mon[27677]: Detected new or changed devices on smithi161 2024-09-17T09:11:28.673 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:28 smithi161 ceph-mon[27677]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T09:11:28.673 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:28 smithi161 ceph-mon[27677]: Cluster is now healthy 2024-09-17T09:11:28.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:28 smithi042 ceph-mon[25899]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:28.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:28 smithi042 ceph-mon[25899]: Detected new or changed devices on smithi161 2024-09-17T09:11:28.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:28 smithi042 ceph-mon[25899]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-09-17T09:11:28.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:28 smithi042 ceph-mon[25899]: Cluster is now healthy 2024-09-17T09:11:30.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:30 smithi179 ceph-mon[27782]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:30.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:30 smithi042 ceph-mon[25899]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:30.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:30 smithi161 ceph-mon[27677]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:31.566 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:31 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:31.567 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:31 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.567 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:31 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:31.567 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:31 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:31.567 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:31 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.567 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:31 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:31 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:31.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:31 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:31 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:31.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:31 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:31.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:31 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:31 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:31 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:31.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:31 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:31 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:31.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:31 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:31.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:31 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:31.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:31 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:32.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:32 smithi161 ceph-mon[27677]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:32.942 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:32 smithi042 ceph-mon[25899]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:32.955 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:32 smithi179 ceph-mon[27782]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:34.186 INFO:teuthology.orchestra.run.smithi179.stdout:Created osd(s) 2 on host 'smithi179' 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:34.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:34.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:34.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:34.780 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:34 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:34.803 DEBUG:teuthology.orchestra.run.smithi179:osd.2> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.2.service 2024-09-17T09:11:34.806 INFO:tasks.cephadm:Waiting for 3 OSDs to come up... 2024-09-17T09:11:34.806 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-17T09:11:34.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:34.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T09:11:34.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T09:11:34.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:34.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:34.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:11:34.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:34.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:34.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:34.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:34.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:34 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:35.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:35.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T09:11:35.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:35.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:34 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:35.022 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:11:35.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:35 smithi042 ceph-mon[25899]: Adjusting osd_memory_target on smithi179 to 16064M 2024-09-17T09:11:35.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:35 smithi042 ceph-mon[25899]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T09:11:35.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:35 smithi042 ceph-mon[25899]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T09:11:35.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:35 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:35.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:35 smithi042 ceph-mon[25899]: from='osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-17T09:11:35.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:35 smithi042 ceph-mon[25899]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-17T09:11:36.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:35 smithi161 ceph-mon[27677]: Adjusting osd_memory_target on smithi179 to 16064M 2024-09-17T09:11:36.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:35 smithi161 ceph-mon[27677]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T09:11:36.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:35 smithi161 ceph-mon[27677]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T09:11:36.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:35 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:36.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:35 smithi161 ceph-mon[27677]: from='osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-17T09:11:36.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:35 smithi161 ceph-mon[27677]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-17T09:11:36.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-mon[27782]: Adjusting osd_memory_target on smithi179 to 16064M 2024-09-17T09:11:36.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-mon[27782]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-17T09:11:36.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-mon[27782]: osdmap e16: 3 total, 2 up, 3 in 2024-09-17T09:11:36.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:36.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-mon[27782]: from='osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-17T09:11:36.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-mon[27782]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]: dispatch 2024-09-17T09:11:36.030 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2[34147]: 2024-09-17T09:11:35.644+0000 7f029e884640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T09:11:36.030 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:35 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2[34147]: 2024-09-17T09:11:35.647+0000 7f029a6ad640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T09:11:36.710 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:11:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:36 smithi042 ceph-mon[25899]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:36 smithi042 ceph-mon[25899]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-17T09:11:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:36 smithi042 ceph-mon[25899]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T09:11:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:36 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:36.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:36 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:37.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:36 smithi161 ceph-mon[27677]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:37.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:36 smithi161 ceph-mon[27677]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-17T09:11:37.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:36 smithi161 ceph-mon[27677]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T09:11:37.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:36 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:37.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:36 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:37.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:36 smithi179 ceph-mon[27782]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-17T09:11:37.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:36 smithi179 ceph-mon[27782]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi179", "root=default"]}]': finished 2024-09-17T09:11:37.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:36 smithi179 ceph-mon[27782]: osdmap e17: 3 total, 2 up, 3 in 2024-09-17T09:11:37.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:36 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:37.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:36 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:37.345 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1726564296,"num_in_osds":3,"osd_in_since":1726564278,"num_remapped_pgs":0} 2024-09-17T09:11:37.346 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T09:11:37.546 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:11:37.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:37 smithi042 ceph-mon[25899]: purged_snaps scrub starts 2024-09-17T09:11:37.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:37 smithi042 ceph-mon[25899]: purged_snaps scrub ok 2024-09-17T09:11:37.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:37 smithi042 ceph-mon[25899]: osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272] boot 2024-09-17T09:11:37.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:37 smithi042 ceph-mon[25899]: osdmap e18: 3 total, 3 up, 3 in 2024-09-17T09:11:37.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:37 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:37.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:37 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2622701301' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T09:11:38.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:37 smithi161 ceph-mon[27677]: purged_snaps scrub starts 2024-09-17T09:11:38.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:37 smithi161 ceph-mon[27677]: purged_snaps scrub ok 2024-09-17T09:11:38.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:37 smithi161 ceph-mon[27677]: osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272] boot 2024-09-17T09:11:38.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:37 smithi161 ceph-mon[27677]: osdmap e18: 3 total, 3 up, 3 in 2024-09-17T09:11:38.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:37 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:38.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:37 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/2622701301' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T09:11:38.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:37 smithi179 ceph-mon[27782]: purged_snaps scrub starts 2024-09-17T09:11:38.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:37 smithi179 ceph-mon[27782]: purged_snaps scrub ok 2024-09-17T09:11:38.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:37 smithi179 ceph-mon[27782]: osd.2 [v2:172.21.15.179:6800/871554272,v1:172.21.15.179:6801/871554272] boot 2024-09-17T09:11:38.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:37 smithi179 ceph-mon[27782]: osdmap e18: 3 total, 3 up, 3 in 2024-09-17T09:11:38.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:37 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:11:38.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:37 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/2622701301' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-17T09:11:38.927 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:38 smithi042 ceph-mon[25899]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:38.928 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:38 smithi042 ceph-mon[25899]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T09:11:38.928 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:38 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:11:38.928 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:38 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:38.928 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:38 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:38.928 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:38 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:39.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:38 smithi161 ceph-mon[27677]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:39.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:38 smithi161 ceph-mon[27677]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T09:11:39.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:38 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:11:39.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:38 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:39.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:38 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:39.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:38 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:39.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:38 smithi179 ceph-mon[27782]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:39.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:38 smithi179 ceph-mon[27782]: osdmap e19: 3 total, 3 up, 3 in 2024-09-17T09:11:39.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:38 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:11:39.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:38 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:39.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:38 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:39.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:38 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:39.446 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:11:39.446 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"fsid":"3dd20088-74d4-11ef-bceb-c7b262605968","created":"2024-09-17T09:08:23.498441+0000","modified":"2024-09-17T09:11:38.644290+0000","last_up_change":"2024-09-17T09:11:36.632115+0000","last_in_change":"2024-09-17T09:11:18.155400+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T09:11:38.133300+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"684fe44c-84df-450d-89af-befb1a2bffe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6803","nonce":2756799953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6805","nonce":2756799953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6809","nonce":2756799953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6807","nonce":2756799953}]},"public_addr":"172.21.15.42:6803/2756799953","cluster_addr":"172.21.15.42:6805/2756799953","heartbeat_back_addr":"172.21.15.42:6809/2756799953","heartbeat_front_addr":"172.21.15.42:6807/2756799953","state":["exists","up"]},{"osd":1,"uuid":"cc71e050-4540-485d-8d4b-0ddd804e106d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6801","nonce":1794465620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6803","nonce":1794465620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6807","nonce":1794465620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6805","nonce":1794465620}]},"public_addr":"172.21.15.161:6801/1794465620","cluster_addr":"172.21.15.161:6803/1794465620","heartbeat_back_addr":"172.21.15.161:6807/1794465620","heartbeat_front_addr":"172.21.15.161:6805/1794465620","state":["exists","up"]},{"osd":2,"uuid":"69b94f3d-842c-464e-af5a-36fdbc243f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6801","nonce":871554272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6803","nonce":871554272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6807","nonce":871554272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6805","nonce":871554272}]},"public_addr":"172.21.15.179:6801/871554272","cluster_addr":"172.21.15.179:6803/871554272","heartbeat_back_addr":"172.21.15.179:6807/871554272","heartbeat_front_addr":"172.21.15.179:6805/871554272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:10:46.656253+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:11:11.242023+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:11:34.753972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/2020475853":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3337791658":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/2653202478":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3199620492":"2024-09-18T09:08:45.988132+0000","172.21.15.42:0/1593864090":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6801/1234820444":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6801/1922140672":"2024-09-18T09:09:09.624408+0000","172.21.15.42:6800/1922140672":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3276664722":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6800/1234820444":"2024-09-18T09:08:45.988132+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T09:11:39.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:39 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T09:11:39.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:39 smithi042 ceph-mon[25899]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T09:11:39.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:39 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:11:39.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:39 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3034185879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:11:40.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:39 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T09:11:40.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:39 smithi161 ceph-mon[27677]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T09:11:40.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:39 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:11:40.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:39 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3034185879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:11:40.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:39 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-17T09:11:40.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:39 smithi179 ceph-mon[27782]: osdmap e20: 3 total, 3 up, 3 in 2024-09-17T09:11:40.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:39 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-17T09:11:40.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:39 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3034185879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:11:40.155 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T09:11:38.133300+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 3, 'score_stable': 3, 'optimal_score': 1, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T09:11:40.155 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-17T09:11:40.371 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:11:40.474 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40285]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2024-09-17T09:11:40.474 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40285]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:40.474 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:40.474 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40285]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:40.745 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40361]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme linux smart-log-add --json /dev/nvme1n1 2024-09-17T09:11:40.745 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40361]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:40.745 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:40.746 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:11:40 smithi042 sudo[40361]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:40.746 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:40 smithi042 ceph-mon[25899]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:40.746 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:40 smithi042 ceph-mon[25899]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:40.746 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:40 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T09:11:40.746 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:40 smithi042 ceph-mon[25899]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T09:11:40.923 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:40 smithi161 ceph-mon[27677]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:40.924 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:40 smithi161 ceph-mon[27677]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:40.924 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:40 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T09:11:40.924 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:40 smithi161 ceph-mon[27677]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T09:11:41.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:40 smithi179 ceph-mon[27782]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:41.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:40 smithi179 ceph-mon[27782]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-17T09:11:41.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:40 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-17T09:11:41.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:40 smithi179 ceph-mon[27782]: osdmap e21: 3 total, 3 up, 3 in 2024-09-17T09:11:41.178 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:40 smithi161 sudo[34552]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2024-09-17T09:11:41.179 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:40 smithi161 sudo[34552]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:41.179 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:40 smithi161 sudo[34552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:41.179 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:40 smithi161 sudo[34552]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:41.518 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:41 smithi161 sudo[34555]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme linux smart-log-add --json /dev/nvme1n1 2024-09-17T09:11:41.518 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:41 smithi161 sudo[34555]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:41.518 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:41 smithi161 sudo[34555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:41.518 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:11:41 smithi161 sudo[34555]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:41.702 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:41 smithi179 ceph-mon[27782]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T09:11:41.702 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:41 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:41.702 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:41 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:41.702 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35126]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2024-09-17T09:11:41.702 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35126]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:41.702 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:41.702 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35126]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:41.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:41 smithi042 ceph-mon[25899]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T09:11:41.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:41.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:41 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:42.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:41 smithi161 ceph-mon[27677]: osdmap e22: 3 total, 3 up, 3 in 2024-09-17T09:11:42.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:41 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:42.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:41 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:42.028 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35129]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme linux smart-log-add --json /dev/nvme1n1 2024-09-17T09:11:42.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35129]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:42.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:42.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:11:41 smithi179 sudo[35129]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:42.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40468]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T09:11:42.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40468]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:42.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:42.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40468]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:42.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40491]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T09:11:42.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40491]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:42.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:42.836 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:42 smithi042 sudo[40491]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:43.148 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:42 smithi179 sudo[35132]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T09:11:43.148 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:42 smithi179 sudo[35132]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:43.148 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:42 smithi179 sudo[35132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:43.149 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:42 smithi179 sudo[35132]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:43.420 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:43.420 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T09:11:43.420 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: Cluster is now healthy 2024-09-17T09:11:43.420 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:43.420 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:43.420 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:43.421 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34558]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: Cluster is now healthy 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:43.432 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:43.433 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:43 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 sudo[35135]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T09:11:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 sudo[35135]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 sudo[35135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 sudo[35135]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: pgmap v97: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-17T09:11:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: Cluster is now healthy 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:43.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:43 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:43.673 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34558]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:43.673 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:43.673 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34558]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:43.804 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2024-09-17T09:11:44.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34561]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-17T09:11:44.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34561]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-17T09:11:44.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-17T09:11:44.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:43 smithi161 sudo[34561]: pam_unix(sudo:session): session closed for user root 2024-09-17T09:11:44.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:44.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:44.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: mgrmap e16: y(active, since 2m), standbys: z, x 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:44.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:44 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1216339749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T09:11:44.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:44.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:44.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: mgrmap e16: y(active, since 2m), standbys: z, x 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:44.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:44 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1216339749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T09:11:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: mgrmap e16: y(active, since 2m), standbys: z, x 2024-09-17T09:11:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-17T09:11:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:11:44.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:11:44.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:11:44.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-17T09:11:44.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:44.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:44 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1216339749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-17T09:11:44.906 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi042 2024-09-17T09:11:44.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch apply rgw foo.a --placement '1;smithi042=foo.a' 2024-09-17T09:11:45.114 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:11:46.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:46 smithi179 ceph-mon[27782]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:46.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:46 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:46 smithi042 ceph-mon[25899]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:46.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:46 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:46 smithi161 ceph-mon[27677]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:46.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:46.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:46 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.448 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled rgw.foo.a update... 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: Detected new or changed devices on smithi179 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:47.748 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.749 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T09:11:47.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T09:11:47.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.750 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:47 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: Detected new or changed devices on smithi179 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.770 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.771 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T09:11:47.771 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T09:11:47.771 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.771 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:47 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.848 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: Detected new or changed devices on smithi179 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.849 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:47.850 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:47 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:48.071 DEBUG:teuthology.orchestra.run.smithi042:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@rgw.foo.a.service 2024-09-17T09:11:48.074 INFO:tasks.cephadm:Adding prometheus.a on smithi161 2024-09-17T09:11:48.074 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch apply prometheus '1;smithi161=a' 2024-09-17T09:11:48.267 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:11:48.718 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:48 smithi179 ceph-mon[27782]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:48.718 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:48 smithi179 ceph-mon[27782]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi042=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:48.718 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:48 smithi179 ceph-mon[27782]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-17T09:11:48.718 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:48 smithi179 ceph-mon[27782]: Deploying daemon rgw.foo.a on smithi042 2024-09-17T09:11:48.918 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:48 smithi042 ceph-mon[25899]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:48.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:48 smithi042 ceph-mon[25899]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi042=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:48.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:48 smithi042 ceph-mon[25899]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-17T09:11:48.919 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:48 smithi042 ceph-mon[25899]: Deploying daemon rgw.foo.a on smithi042 2024-09-17T09:11:49.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:48 smithi161 ceph-mon[27677]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:11:49.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:48 smithi161 ceph-mon[27677]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi042=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:49.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:48 smithi161 ceph-mon[27677]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-17T09:11:49.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:48 smithi161 ceph-mon[27677]: Deploying daemon rgw.foo.a on smithi042 2024-09-17T09:11:49.627 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:11:49 smithi042 systemd[1]: Starting Ceph rgw.foo.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:11:49.877 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:11:49 smithi042 podman[41026]: 2024-09-17 09:11:49.529259224 +0000 UTC m=+0.016347874 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:11:49.877 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:11:49 smithi042 podman[41026]: 2024-09-17 09:11:49.637185906 +0000 UTC m=+0.124274540 container create f21157d9d39fe1497be244660c6f9a7c6077c1dde03373d0f4b2eb68ac37c0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-17T09:11:49.988 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled prometheus update... 2024-09-17T09:11:50.474 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:11:49 smithi042 podman[41026]: 2024-09-17 09:11:49.989866428 +0000 UTC m=+0.476955078 container init f21157d9d39fe1497be244660c6f9a7c6077c1dde03373d0f4b2eb68ac37c0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, GIT_CLEAN=True) 2024-09-17T09:11:50.474 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:11:49 smithi042 podman[41026]: 2024-09-17 09:11:49.994808564 +0000 UTC m=+0.481897200 container start f21157d9d39fe1497be244660c6f9a7c6077c1dde03373d0f4b2eb68ac37c0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=reef-19e2a2b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-17T09:11:50.474 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:11:50 smithi042 bash[41026]: f21157d9d39fe1497be244660c6f9a7c6077c1dde03373d0f4b2eb68ac37c0ae 2024-09-17T09:11:50.474 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:11:50 smithi042 systemd[1]: Started Ceph rgw.foo.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:11:50.906 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 206 KiB/s wr, 14 op/s 2024-09-17T09:11:50.906 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.906 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:50.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:50.907 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:50 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 206 KiB/s wr, 14 op/s 2024-09-17T09:11:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:50.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:50 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:51.018 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 206 KiB/s wr, 14 op/s 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:11:51.019 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:50 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:11:51.618 DEBUG:teuthology.orchestra.run.smithi161:prometheus.a> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@prometheus.a.service 2024-09-17T09:11:51.621 INFO:tasks.cephadm:Adding node-exporter.a on smithi042 2024-09-17T09:11:51.621 INFO:tasks.cephadm:Adding node-exporter.b on smithi161 2024-09-17T09:11:51.621 INFO:tasks.cephadm:Adding node-exporter.c on smithi179 2024-09-17T09:11:51.621 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch apply node-exporter '3;smithi042=a;smithi161=b;smithi179=c' 2024-09-17T09:11:51.897 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:11:51.920 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:51 smithi161 ceph-mon[27677]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi161=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:51.920 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:51 smithi161 ceph-mon[27677]: Saving service prometheus spec with placement smithi161=a;count:1 2024-09-17T09:11:51.920 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:51 smithi161 ceph-mon[27677]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-17T09:11:51.920 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:51 smithi161 ceph-mon[27677]: Checking dashboard <-> RGW credentials 2024-09-17T09:11:51.920 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:51 smithi161 ceph-mon[27677]: osdmap e23: 3 total, 3 up, 3 in 2024-09-17T09:11:51.920 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:51 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T09:11:51.920 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:51 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/459305672' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T09:11:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:51 smithi042 ceph-mon[25899]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi161=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:51 smithi042 ceph-mon[25899]: Saving service prometheus spec with placement smithi161=a;count:1 2024-09-17T09:11:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:51 smithi042 ceph-mon[25899]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-17T09:11:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:51 smithi042 ceph-mon[25899]: Checking dashboard <-> RGW credentials 2024-09-17T09:11:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:51 smithi042 ceph-mon[25899]: osdmap e23: 3 total, 3 up, 3 in 2024-09-17T09:11:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:51 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T09:11:51.974 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:51 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/459305672' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T09:11:52.018 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:51 smithi179 ceph-mon[27782]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi161=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:52.018 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:51 smithi179 ceph-mon[27782]: Saving service prometheus spec with placement smithi161=a;count:1 2024-09-17T09:11:52.018 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:51 smithi179 ceph-mon[27782]: Saving service rgw.foo.a spec with placement smithi042=foo.a;count:1 2024-09-17T09:11:52.018 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:51 smithi179 ceph-mon[27782]: Checking dashboard <-> RGW credentials 2024-09-17T09:11:52.018 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:51 smithi179 ceph-mon[27782]: osdmap e23: 3 total, 3 up, 3 in 2024-09-17T09:11:52.018 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:51 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T09:11:52.018 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:51 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/459305672' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-09-17T09:11:53.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:53 smithi042 ceph-mon[25899]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-17T09:11:53.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:53 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T09:11:53.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:53 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/459305672' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T09:11:53.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:53 smithi042 ceph-mon[25899]: osdmap e24: 3 total, 3 up, 3 in 2024-09-17T09:11:53.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:53 smithi179 ceph-mon[27782]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-17T09:11:53.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:53 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T09:11:53.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:53 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/459305672' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T09:11:53.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:53 smithi179 ceph-mon[27782]: osdmap e24: 3 total, 3 up, 3 in 2024-09-17T09:11:53.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:53 smithi161 ceph-mon[27677]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-09-17T09:11:53.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:53 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T09:11:53.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:53 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/459305672' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-09-17T09:11:53.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:53 smithi161 ceph-mon[27677]: osdmap e24: 3 total, 3 up, 3 in 2024-09-17T09:11:54.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:54 smithi179 ceph-mon[27782]: pgmap v106: 33 pgs: 14 creating+peering, 18 unknown, 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 123 KiB/s wr, 8 op/s 2024-09-17T09:11:54.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:54 smithi179 ceph-mon[27782]: osdmap e25: 3 total, 3 up, 3 in 2024-09-17T09:11:54.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:54 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:54 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3159424311' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:54 smithi179 ceph-mon[27782]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:54 smithi042 ceph-mon[25899]: pgmap v106: 33 pgs: 14 creating+peering, 18 unknown, 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 123 KiB/s wr, 8 op/s 2024-09-17T09:11:54.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:54 smithi042 ceph-mon[25899]: osdmap e25: 3 total, 3 up, 3 in 2024-09-17T09:11:54.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:54 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:54 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3159424311' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:54 smithi042 ceph-mon[25899]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:54 smithi161 ceph-mon[27677]: pgmap v106: 33 pgs: 14 creating+peering, 18 unknown, 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 123 KiB/s wr, 8 op/s 2024-09-17T09:11:54.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:54 smithi161 ceph-mon[27677]: osdmap e25: 3 total, 3 up, 3 in 2024-09-17T09:11:54.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:54 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:54 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3159424311' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:54 smithi161 ceph-mon[27677]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-09-17T09:11:54.990 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled node-exporter update... 2024-09-17T09:11:55.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T09:11:55.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T09:11:55.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: osdmap e26: 3 total, 3 up, 3 in 2024-09-17T09:11:55.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "3;smithi042=a;smithi161=b;smithi179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:55.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: Saving service node-exporter spec with placement smithi042=a;smithi161=b;smithi179=c;count:3 2024-09-17T09:11:55.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.225 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:55 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: osdmap e26: 3 total, 3 up, 3 in 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "3;smithi042=a;smithi161=b;smithi179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: Saving service node-exporter spec with placement smithi042=a;smithi161=b;smithi179=c;count:3 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:55 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T09:11:55.521 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-09-17T09:11:55.521 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: osdmap e26: 3 total, 3 up, 3 in 2024-09-17T09:11:55.521 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: from='client.24271 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "3;smithi042=a;smithi161=b;smithi179=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:55.521 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: Saving service node-exporter spec with placement smithi042=a;smithi161=b;smithi179=c;count:3 2024-09-17T09:11:55.521 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.521 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.521 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:55 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:55.639 DEBUG:teuthology.orchestra.run.smithi042:node-exporter.a> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.a.service 2024-09-17T09:11:55.643 DEBUG:teuthology.orchestra.run.smithi161:node-exporter.b> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.b.service 2024-09-17T09:11:55.646 DEBUG:teuthology.orchestra.run.smithi179:node-exporter.c> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.c.service 2024-09-17T09:11:55.649 INFO:tasks.cephadm:Adding alertmanager.a on smithi042 2024-09-17T09:11:55.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch apply alertmanager '1;smithi042=a' 2024-09-17T09:11:55.881 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:11:56.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: pgmap v109: 65 pgs: 31 active+clean, 25 creating+peering, 9 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:11:56.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: osdmap e27: 3 total, 3 up, 3 in 2024-09-17T09:11:56.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3159424311' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:56 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: pgmap v109: 65 pgs: 31 active+clean, 25 creating+peering, 9 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:11:56.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: osdmap e27: 3 total, 3 up, 3 in 2024-09-17T09:11:56.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3159424311' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:56 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: pgmap v109: 65 pgs: 31 active+clean, 25 creating+peering, 9 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-09-17T09:11:56.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: osdmap e27: 3 total, 3 up, 3 in 2024-09-17T09:11:56.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3159424311' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: from='client.? ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-09-17T09:11:56.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:56.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:56 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:57.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:57 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T09:11:57.372 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:57 smithi179 ceph-mon[27782]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T09:11:57.373 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:57 smithi179 ceph-mon[27782]: osdmap e28: 3 total, 3 up, 3 in 2024-09-17T09:11:57.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:57 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T09:11:57.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:57 smithi042 ceph-mon[25899]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T09:11:57.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:57 smithi042 ceph-mon[25899]: osdmap e28: 3 total, 3 up, 3 in 2024-09-17T09:11:57.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:57 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/395613323' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T09:11:57.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:57 smithi161 ceph-mon[27677]: from='client.? ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-09-17T09:11:57.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:57 smithi161 ceph-mon[27677]: osdmap e28: 3 total, 3 up, 3 in 2024-09-17T09:11:57.649 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled alertmanager update... 2024-09-17T09:11:58.234 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: pgmap v112: 97 pgs: 66 active+clean, 11 creating+peering, 20 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:11:58.234 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: osdmap e29: 3 total, 3 up, 3 in 2024-09-17T09:11:58.234 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3538525713' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi042=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:58.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: Saving service alertmanager spec with placement smithi042=a;count:1 2024-09-17T09:11:58.235 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:58 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:58.255 DEBUG:teuthology.orchestra.run.smithi042:alertmanager.a> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@alertmanager.a.service 2024-09-17T09:11:58.261 INFO:tasks.cephadm:Adding grafana.a on smithi161 2024-09-17T09:11:58.261 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph orch apply grafana '1;smithi161=a' 2024-09-17T09:11:58.449 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: pgmap v112: 97 pgs: 66 active+clean, 11 creating+peering, 20 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: osdmap e29: 3 total, 3 up, 3 in 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3538525713' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi042=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: Saving service alertmanager spec with placement smithi042=a;count:1 2024-09-17T09:11:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:58 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:58.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: pgmap v112: 97 pgs: 66 active+clean, 11 creating+peering, 20 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 2 op/s 2024-09-17T09:11:58.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: osdmap e29: 3 total, 3 up, 3 in 2024-09-17T09:11:58.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3538525713' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-09-17T09:11:58.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi042=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:11:58.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: Saving service alertmanager spec with placement smithi042=a;count:1 2024-09-17T09:11:58.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:58 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:11:59.265 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: osdmap e30: 3 total, 3 up, 3 in 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3538525713' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T09:11:59.266 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:11:59 smithi179 ceph-mon[27782]: osdmap e31: 3 total, 3 up, 3 in 2024-09-17T09:11:59.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T09:11:59.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T09:11:59.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: osdmap e30: 3 total, 3 up, 3 in 2024-09-17T09:11:59.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3538525713' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T09:11:59.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T09:11:59.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:11:59 smithi042 ceph-mon[25899]: osdmap e31: 3 total, 3 up, 3 in 2024-09-17T09:11:59.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T09:11:59.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-09-17T09:11:59.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: osdmap e30: 3 total, 3 up, 3 in 2024-09-17T09:11:59.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3538525713' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: from='client.? ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-09-17T09:11:59.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3747079605' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T09:11:59.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: from='client.? ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-09-17T09:11:59.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:11:59 smithi161 ceph-mon[27677]: osdmap e31: 3 total, 3 up, 3 in 2024-09-17T09:12:00.206 INFO:teuthology.orchestra.run.smithi179.stdout:Scheduled grafana update... 2024-09-17T09:12:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:00 smithi179 ceph-mon[27782]: pgmap v115: 129 pgs: 99 active+clean, 30 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T09:12:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:00 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:00 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:00 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:00 smithi179 ceph-mon[27782]: Deploying daemon prometheus.a on smithi161 2024-09-17T09:12:00.504 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:00 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:00 smithi042 ceph-mon[25899]: pgmap v115: 129 pgs: 99 active+clean, 30 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T09:12:00.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:00 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:00 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:00 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:00 smithi042 ceph-mon[25899]: Deploying daemon prometheus.a on smithi161 2024-09-17T09:12:00.725 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:00 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:00 smithi161 ceph-mon[27677]: pgmap v115: 129 pgs: 99 active+clean, 30 unknown; 578 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-17T09:12:00.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:00 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:00 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:00 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:00 smithi161 ceph-mon[27677]: Deploying daemon prometheus.a on smithi161 2024-09-17T09:12:00.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:00 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:00.809 DEBUG:teuthology.orchestra.run.smithi161:grafana.a> sudo journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@grafana.a.service 2024-09-17T09:12:00.811 INFO:tasks.cephadm:Setting up client nodes... 2024-09-17T09:12:00.812 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T09:12:01.024 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:01.410 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:01 smithi042 ceph-mon[25899]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi161=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:12:01.410 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:01 smithi042 ceph-mon[25899]: Saving service grafana spec with placement smithi161=a;count:1 2024-09-17T09:12:01.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:01 smithi179 ceph-mon[27782]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi161=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:12:01.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:01 smithi179 ceph-mon[27782]: Saving service grafana spec with placement smithi161=a;count:1 2024-09-17T09:12:01.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:01 smithi161 ceph-mon[27677]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi161=a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:12:01.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:01 smithi161 ceph-mon[27677]: Saving service grafana spec with placement smithi161=a;count:1 2024-09-17T09:12:02.506 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:02 smithi042 ceph-mon[25899]: pgmap v117: 129 pgs: 120 active+clean, 9 unknown; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 3.1 KiB/s wr, 32 op/s 2024-09-17T09:12:02.620 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:02 smithi161 ceph-mon[27677]: pgmap v117: 129 pgs: 120 active+clean, 9 unknown; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 3.1 KiB/s wr, 32 op/s 2024-09-17T09:12:02.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:02 smithi179 ceph-mon[27782]: pgmap v117: 129 pgs: 120 active+clean, 9 unknown; 579 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 12 KiB/s rd, 3.1 KiB/s wr, 32 op/s 2024-09-17T09:12:02.843 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-09-17T09:12:02.843 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDiR+lm/5f+MRAAFIWM0JpCXAdfclZGg7vkrg== 2024-09-17T09:12:03.404 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:03 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3894227605' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:03.404 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:03 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3894227605' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:03.426 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:12:03.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-17T09:12:03.427 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T09:12:03.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T09:12:03.490 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:03 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3894227605' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:03.490 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:03 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3894227605' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:03.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:03 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3894227605' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:03.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:03 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3894227605' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:03.982 INFO:teuthology.orchestra.run.smithi161.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.b/config 2024-09-17T09:12:04.441 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:04 smithi161 ceph-mon[27677]: pgmap v118: 129 pgs: 129 active+clean; 581 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 4.3 KiB/s wr, 77 op/s 2024-09-17T09:12:04.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:04 smithi042 ceph-mon[25899]: pgmap v118: 129 pgs: 129 active+clean; 581 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 4.3 KiB/s wr, 77 op/s 2024-09-17T09:12:04.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:04 smithi179 ceph-mon[27782]: pgmap v118: 129 pgs: 129 active+clean; 581 KiB data, 94 MiB used, 268 GiB / 268 GiB avail; 30 KiB/s rd, 4.3 KiB/s wr, 77 op/s 2024-09-17T09:12:06.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:06 smithi161 ceph-mon[27677]: pgmap v119: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 4.6 KiB/s wr, 142 op/s 2024-09-17T09:12:06.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:06 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:06 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:06 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:06 smithi042 ceph-mon[25899]: pgmap v119: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 4.6 KiB/s wr, 142 op/s 2024-09-17T09:12:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:06 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:06 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:06 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:06 smithi179 ceph-mon[27782]: pgmap v119: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 58 KiB/s rd, 4.6 KiB/s wr, 142 op/s 2024-09-17T09:12:06.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:06 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:06 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:06.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:06 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:08 smithi161 ceph-mon[27677]: pgmap v120: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 4.1 KiB/s wr, 126 op/s 2024-09-17T09:12:08.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:08 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:08 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:08 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:08 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:08 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:08 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:08 smithi042 ceph-mon[25899]: pgmap v120: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 4.1 KiB/s wr, 126 op/s 2024-09-17T09:12:08.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:08 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:08 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:08 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:08 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:08 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:08 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:08 smithi179 ceph-mon[27782]: pgmap v120: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 52 KiB/s rd, 4.1 KiB/s wr, 126 op/s 2024-09-17T09:12:08.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:08 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:08 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:08 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:08 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:08 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:08.530 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:08 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:09.746 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2024-09-17T09:12:09.746 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDpR+lmUb8zLBAA+fXAuhxeBnIv1LnoIuQPQA== 2024-09-17T09:12:10.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:10 smithi179 ceph-mon[27782]: pgmap v121: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 3.5 KiB/s wr, 111 op/s 2024-09-17T09:12:10.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:10 smithi179 ceph-mon[27782]: from='client.? 172.21.15.161:0/1953951245' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:10.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:10 smithi179 ceph-mon[27782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:10.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:10 smithi179 ceph-mon[27782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:10.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:10 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:10.405 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:10 smithi161 ceph-mon[27677]: pgmap v121: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 3.5 KiB/s wr, 111 op/s 2024-09-17T09:12:10.405 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:10 smithi161 ceph-mon[27677]: from='client.? 172.21.15.161:0/1953951245' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:10.405 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:10 smithi161 ceph-mon[27677]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:10.405 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:10 smithi161 ceph-mon[27677]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:10.406 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:10 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:10 smithi042 ceph-mon[25899]: pgmap v121: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 46 KiB/s rd, 3.5 KiB/s wr, 111 op/s 2024-09-17T09:12:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:10 smithi042 ceph-mon[25899]: from='client.? 172.21.15.161:0/1953951245' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:10 smithi042 ceph-mon[25899]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:10 smithi042 ceph-mon[25899]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:10.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:10 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:10.989 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:12:10.989 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-17T09:12:10.989 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T09:12:11.069 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-17T09:12:11.280 INFO:teuthology.orchestra.run.smithi179.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.c/config 2024-09-17T09:12:12.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:12 smithi161 ceph-mon[27677]: pgmap v122: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 3.0 KiB/s wr, 94 op/s 2024-09-17T09:12:12.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:12 smithi179 ceph-mon[27782]: pgmap v122: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 3.0 KiB/s wr, 94 op/s 2024-09-17T09:12:12.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:12 smithi042 ceph-mon[25899]: pgmap v122: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 38 KiB/s rd, 3.0 KiB/s wr, 94 op/s 2024-09-17T09:12:13.644 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2024-09-17T09:12:13.644 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDtR+lmRVYoJhAAQ8q7XrhGIgyQi29dykwdkw== 2024-09-17T09:12:13.747 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:13 smithi161 systemd[1]: Starting Ceph prometheus.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:12:14.018 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:13 smithi161 podman[35894]: 2024-09-17 09:12:13.857629568 +0000 UTC m=+0.016474348 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-09-17T09:12:14.018 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:13 smithi161 podman[35894]: 2024-09-17 09:12:13.958524402 +0000 UTC m=+0.117369224 container create 16468f82e75243bddabfbdc181f8be93dbe451dd5bfa7a224d0c5b7c7e11d0ee (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T09:12:14.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:14 smithi042 ceph-mon[25899]: pgmap v123: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 1.9 KiB/s wr, 80 op/s 2024-09-17T09:12:14.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:14 smithi042 ceph-mon[25899]: from='client.? 172.21.15.179:0/2593059117' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:14.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:14 smithi042 ceph-mon[25899]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:14.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:14 smithi042 ceph-mon[25899]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:14.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:14 smithi179 ceph-mon[27782]: pgmap v123: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 1.9 KiB/s wr, 80 op/s 2024-09-17T09:12:14.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:14 smithi179 ceph-mon[27782]: from='client.? 172.21.15.179:0/2593059117' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:14.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:14 smithi179 ceph-mon[27782]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:14.254 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:14 smithi179 ceph-mon[27782]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:14.275 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:12:14.276 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.client.2.keyring 2024-09-17T09:12:14.276 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T09:12:14.315 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T09:12:14.315 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-17T09:12:14.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-17T09:12:14.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-mon[27677]: pgmap v123: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 34 KiB/s rd, 1.9 KiB/s wr, 80 op/s 2024-09-17T09:12:14.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-mon[27677]: from='client.? 172.21.15.179:0/2593059117' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:14.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-mon[27677]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-17T09:12:14.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-mon[27677]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-17T09:12:14.519 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 podman[35894]: 2024-09-17 09:12:14.194130665 +0000 UTC m=+0.352975445 container init 16468f82e75243bddabfbdc181f8be93dbe451dd5bfa7a224d0c5b7c7e11d0ee (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T09:12:14.519 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 podman[35894]: 2024-09-17 09:12:14.199318931 +0000 UTC m=+0.358163712 container start 16468f82e75243bddabfbdc181f8be93dbe451dd5bfa7a224d0c5b7c7e11d0ee (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T09:12:14.519 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.223Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.223Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.223Z caller=main.go:570 level=info host_details="(Linux 5.14.0-508.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024 x86_64 smithi161 (none))" 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.223Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.223Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.224Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.225Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.225Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.226Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-09-17T09:12:14.520 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.228Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.228Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.055µs 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.228Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.228Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.228Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=27.467µs wal_replay_duration=348.094µs wbl_replay_duration=123ns total_replay_duration=403.284µs 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.229Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.229Z caller=main.go:1029 level=info msg="TSDB started" 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.229Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.249Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=20.113867ms db_storage=744ns remote_storage=1.005µs web_handler=349ns query_engine=770ns scrape=383.652µs scrape_sd=75.135µs notify=732ns notify_sd=1.823µs rules=19.363336ms tracing=23.551µs 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.249Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:12:14.249Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 bash[35894]: 16468f82e75243bddabfbdc181f8be93dbe451dd5bfa7a224d0c5b7c7e11d0ee 2024-09-17T09:12:14.521 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:12:14 smithi161 systemd[1]: Started Ceph prometheus.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:12:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:15.350 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.350 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.351 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.351 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T09:12:15.351 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.351 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.351 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.351 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.562 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: ignoring --setuser ceph since I am not root 2024-09-17T09:12:15.562 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: ignoring --setgroup ceph since I am not root 2024-09-17T09:12:15.562 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mgr[29336]: -- 172.21.15.161:0/3680712209 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559c3424cd00 con 0x559c34220800 2024-09-17T09:12:15.562 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:15.503+0000 7f60ec68f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:12:15.562 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:15.560+0000 7f60ec68f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.563 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.611 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ignoring --setuser ceph since I am not root 2024-09-17T09:12:15.611 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ignoring --setgroup ceph since I am not root 2024-09-17T09:12:15.612 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:15.517+0000 7f9ed3a38040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:12:15.612 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:15.576+0000 7f9ed3a38040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' 2024-09-17T09:12:15.710 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: ignoring --setuser ceph since I am not root 2024-09-17T09:12:15.711 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: ignoring --setgroup ceph since I am not root 2024-09-17T09:12:15.711 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-mgr[30192]: -- 172.21.15.179:0/117453576 <== mon.2 v2:172.21.15.161:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55be05d86d00 con 0x55be05d5b400 2024-09-17T09:12:15.711 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:15.506+0000 7f34b1e8e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T09:12:15.711 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:15.562+0000 7f34b1e8e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T09:12:15.711 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:15.708+0000 7f34b1e8e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:12:15.901 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:15.709+0000 7f60ec68f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:12:15.901 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:15.776+0000 7f60ec68f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:12:15.952 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:15.733+0000 7f9ed3a38040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T09:12:15.952 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:15.801+0000 7f9ed3a38040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:12:15.952 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:15 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:15.951+0000 7f9ed3a38040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:12:16.029 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:15.774+0000 7f34b1e8e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T09:12:16.029 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:15 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:15.915+0000 7f34b1e8e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:12:16.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:16 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:16.099+0000 7f9ed3a38040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:12:16.268 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:15 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:15.923+0000 7f60ec68f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:12:16.268 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:16 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:16.062+0000 7f60ec68f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:12:16.354 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:16 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:16.051+0000 7f34b1e8e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T09:12:16.354 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:16 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:16.352+0000 7f34b1e8e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:12:16.611 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:16 smithi161 ceph-mon[27677]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T09:12:16.612 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:16 smithi161 ceph-mon[27677]: mgrmap e17: y(active, since 3m), standbys: z, x 2024-09-17T09:12:16.612 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:16 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:16.370+0000 7f60ec68f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:12:16.612 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:16 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:16.430+0000 7f60ec68f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:12:16.612 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:16 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:16.610+0000 7f60ec68f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:12:16.629 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:16 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:16.427+0000 7f9ed3a38040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T09:12:16.629 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:16 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:16.489+0000 7f9ed3a38040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:12:16.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:16 smithi042 ceph-mon[25899]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T09:12:16.629 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:16 smithi042 ceph-mon[25899]: mgrmap e17: y(active, since 3m), standbys: z, x 2024-09-17T09:12:16.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:16 smithi179 ceph-mon[27782]: from='mgr.14150 172.21.15.42:0/1918444157' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-17T09:12:16.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:16 smithi179 ceph-mon[27782]: mgrmap e17: y(active, since 3m), standbys: z, x 2024-09-17T09:12:16.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:16 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:16.413+0000 7f34b1e8e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T09:12:16.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:16 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:16.593+0000 7f34b1e8e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:12:16.943 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:16 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:16.683+0000 7f9ed3a38040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T09:12:17.091 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:12:17.608 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:17 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1548654548' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T09:12:17.686 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":2286834207},{"type":"v1","addr":"172.21.15.42:6801","nonce":2286834207}]},"active_addr":"172.21.15.42:6801/2286834207","active_change":"2024-09-17T09:09:09.624515+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.42:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":4101290312}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":1705199431}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":605601305}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.42:0","nonce":206545066}]}]} 2024-09-17T09:12:17.695 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-17T09:12:17.695 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-17T09:12:17.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T09:12:17.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:17 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1548654548' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T09:12:17.768 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:17 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:17.467+0000 7f60ec68f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:12:17.768 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:17 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:17.533+0000 7f60ec68f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:12:17.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:17 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1548654548' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-17T09:12:17.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:17 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:17.450+0000 7f34b1e8e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:12:17.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:17 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:17.515+0000 7f34b1e8e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:12:17.905 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:17.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:17 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:17.607+0000 7f9ed3a38040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T09:12:17.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:17 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:17.677+0000 7f9ed3a38040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T09:12:18.476 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.219+0000 7f34b1e8e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:12:18.476 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.333+0000 7f34b1e8e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:12:18.485 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.231+0000 7f60ec68f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:12:18.485 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.344+0000 7f60ec68f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:12:18.575 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:18 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:18.455+0000 7f9ed3a38040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T09:12:18.575 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:18 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:18.574+0000 7f9ed3a38040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T09:12:18.749 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.475+0000 7f34b1e8e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:12:18.750 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.535+0000 7f34b1e8e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:12:18.750 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.681+0000 7f34b1e8e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:12:18.750 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.748+0000 7f34b1e8e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:12:18.760 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.483+0000 7f60ec68f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:12:18.760 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.544+0000 7f60ec68f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:12:18.760 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.692+0000 7f60ec68f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:12:18.760 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.758+0000 7f60ec68f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:12:18.941 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:18 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:18.723+0000 7f9ed3a38040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T09:12:18.941 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:18 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:18.787+0000 7f9ed3a38040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T09:12:18.941 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:18 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:18.940+0000 7f9ed3a38040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T09:12:19.018 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.817+0000 7f60ec68f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:12:19.018 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:18 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:18.970+0000 7f60ec68f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:12:19.026 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.806+0000 7f34b1e8e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:12:19.026 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:18 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:18.961+0000 7f34b1e8e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:12:19.026 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:19 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:19.025+0000 7f34b1e8e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:12:19.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.010+0000 7f9ed3a38040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T09:12:19.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.073+0000 7f9ed3a38040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T09:12:19.279 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:19 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:19.090+0000 7f34b1e8e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:12:19.279 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:19 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:19.171+0000 7f34b1e8e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:12:19.279 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:19 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:19.228+0000 7f34b1e8e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:12:19.296 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:19 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:19.034+0000 7f60ec68f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:12:19.296 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:19 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:19.098+0000 7f60ec68f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:12:19.296 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:19 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:19.179+0000 7f60ec68f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:12:19.296 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:19 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:19.237+0000 7f60ec68f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:12:19.296 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:19 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:19.294+0000 7f60ec68f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:12:19.527 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.239+0000 7f9ed3a38040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T09:12:19.527 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.307+0000 7f9ed3a38040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T09:12:19.528 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.377+0000 7f9ed3a38040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T09:12:19.528 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.465+0000 7f9ed3a38040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T09:12:19.528 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.526+0000 7f9ed3a38040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T09:12:19.779 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:19 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:19.285+0000 7f34b1e8e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:12:19.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:12:19.800 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":31,"fsid":"3dd20088-74d4-11ef-bceb-c7b262605968","created":"2024-09-17T09:08:23.498441+0000","modified":"2024-09-17T09:11:59.130826+0000","last_up_change":"2024-09-17T09:11:36.632115+0000","last_in_change":"2024-09-17T09:11:18.155400+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T09:11:38.133300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-17T09:11:50.464867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-17T09:11:52.569726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-09-17T09:11:54.549579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.meta","create_time":"2024-09-17T09:11:56.620716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"684fe44c-84df-450d-89af-befb1a2bffe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6803","nonce":2756799953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6805","nonce":2756799953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6809","nonce":2756799953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6807","nonce":2756799953}]},"public_addr":"172.21.15.42:6803/2756799953","cluster_addr":"172.21.15.42:6805/2756799953","heartbeat_back_addr":"172.21.15.42:6809/2756799953","heartbeat_front_addr":"172.21.15.42:6807/2756799953","state":["exists","up"]},{"osd":1,"uuid":"cc71e050-4540-485d-8d4b-0ddd804e106d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6801","nonce":1794465620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6803","nonce":1794465620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6807","nonce":1794465620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6805","nonce":1794465620}]},"public_addr":"172.21.15.161:6801/1794465620","cluster_addr":"172.21.15.161:6803/1794465620","heartbeat_back_addr":"172.21.15.161:6807/1794465620","heartbeat_front_addr":"172.21.15.161:6805/1794465620","state":["exists","up"]},{"osd":2,"uuid":"69b94f3d-842c-464e-af5a-36fdbc243f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6801","nonce":871554272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6803","nonce":871554272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6807","nonce":871554272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6805","nonce":871554272}]},"public_addr":"172.21.15.179:6801/871554272","cluster_addr":"172.21.15.179:6803/871554272","heartbeat_back_addr":"172.21.15.179:6807/871554272","heartbeat_front_addr":"172.21.15.179:6805/871554272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:10:46.656253+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:11:11.242023+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:11:34.753972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/2020475853":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3337791658":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/2653202478":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3199620492":"2024-09-18T09:08:45.988132+0000","172.21.15.42:0/1593864090":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6801/1234820444":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6801/1922140672":"2024-09-18T09:09:09.624408+0000","172.21.15.42:6800/1922140672":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3276664722":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6800/1234820444":"2024-09-18T09:08:45.988132+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T09:12:19.800 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:19.589+0000 7f9ed3a38040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T09:12:20.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:19 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/564405150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:12:20.165 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:19 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/564405150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:12:20.165 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:20.056+0000 7f34b1e8e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:12:20.166 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: [17/Sep/2024:09:12:20] ENGINE Bus STARTING 2024-09-17T09:12:20.166 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: CherryPy Checker: 2024-09-17T09:12:20.166 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: The Application mounted at '' has an empty config. 2024-09-17T09:12:20.166 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: 2024-09-17T09:12:20.166 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: [17/Sep/2024:09:12:20] ENGINE Serving on http://:::9283 2024-09-17T09:12:20.167 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z[30126]: [17/Sep/2024:09:12:20] ENGINE Bus STARTED 2024-09-17T09:12:20.170 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:19 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/564405150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:12:20.171 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:20.061+0000 7f60ec68f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:12:20.171 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: [17/Sep/2024:09:12:20] ENGINE Bus STARTING 2024-09-17T09:12:20.171 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: CherryPy Checker: 2024-09-17T09:12:20.171 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: The Application mounted at '' has an empty config. 2024-09-17T09:12:20.171 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: 2024-09-17T09:12:20.171 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: [17/Sep/2024:09:12:20] ENGINE Serving on http://:::9283 2024-09-17T09:12:20.171 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x[29313]: [17/Sep/2024:09:12:20] ENGINE Bus STARTED 2024-09-17T09:12:20.498 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-17T09:12:20.498 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-17T09:12:20.718 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:20.725 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:20.411+0000 7f9ed3a38040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T09:12:20.725 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:20] ENGINE Bus STARTING 2024-09-17T09:12:20.725 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: CherryPy Checker: 2024-09-17T09:12:20.725 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: The Application mounted at '' has an empty config. 2024-09-17T09:12:20.726 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:20.726 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:20] ENGINE Serving on http://:::9283 2024-09-17T09:12:20.726 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:20] ENGINE Bus STARTED 2024-09-17T09:12:21.143 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: Standby manager daemon z restarted 2024-09-17T09:12:21.143 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: Standby manager daemon z started 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: Standby manager daemon x restarted 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: Standby manager daemon x started 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:12:21.144 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: Active manager daemon y restarted 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: Activating manager daemon y 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: osdmap e32: 3 total, 3 up, 3 in 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: mgrmap e18: y(active, starting, since 0.0086268s), standbys: z, x 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:12:21.145 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: Manager daemon y is now available 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.146 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:21.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:21.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:12:21.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:12:21.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T09:12:21.147 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:20 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T09:12:21.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: Standby manager daemon z restarted 2024-09-17T09:12:21.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: Standby manager daemon z started 2024-09-17T09:12:21.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-17T09:12:21.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:12:21.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-17T09:12:21.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:12:21.224 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: Standby manager daemon x restarted 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: Standby manager daemon x started 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: Active manager daemon y restarted 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: Activating manager daemon y 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: osdmap e32: 3 total, 3 up, 3 in 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: mgrmap e18: y(active, starting, since 0.0086268s), standbys: z, x 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:12:21.225 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: Manager daemon y is now available 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.226 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T09:12:21.227 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:20 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: Standby manager daemon z restarted 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: Standby manager daemon z started 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.179:0/2965317374' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: Standby manager daemon x restarted 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: Standby manager daemon x started 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-17T09:12:21.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.? 172.21.15.161:0/2790440736' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: Active manager daemon y restarted 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: Activating manager daemon y 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: osdmap e32: 3 total, 3 up, 3 in 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: mgrmap e18: y(active, starting, since 0.0086268s), standbys: z, x 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-17T09:12:21.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: Manager daemon y is now available 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]: dispatch 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi042", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.271 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi161", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:21.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi179", "name": "osd_memory_target"}]': finished 2024-09-17T09:12:21.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:21.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-17T09:12:21.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-17T09:12:21.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-09-17T09:12:21.272 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:20 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-09-17T09:12:22.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:21 smithi042 ceph-mon[25899]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-17T09:12:22.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:21 smithi042 ceph-mon[25899]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-17T09:12:22.162 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:21 smithi042 ceph-mon[25899]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:12:22.162 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:21 smithi042 ceph-mon[25899]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.162 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:21 smithi042 ceph-mon[25899]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.162 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:21 smithi042 ceph-mon[25899]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.162 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:21 smithi042 ceph-mon[25899]: mgrmap e19: y(active, since 1.01588s), standbys: z, x 2024-09-17T09:12:22.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:21 smithi161 ceph-mon[27677]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-17T09:12:22.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:21 smithi161 ceph-mon[27677]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-17T09:12:22.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:21 smithi161 ceph-mon[27677]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:12:22.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:21 smithi161 ceph-mon[27677]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:21 smithi161 ceph-mon[27677]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:21 smithi161 ceph-mon[27677]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:21 smithi161 ceph-mon[27677]: mgrmap e19: y(active, since 1.01588s), standbys: z, x 2024-09-17T09:12:22.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:21 smithi179 ceph-mon[27782]: Updating smithi042:/etc/ceph/ceph.conf 2024-09-17T09:12:22.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:21 smithi179 ceph-mon[27782]: Updating smithi161:/etc/ceph/ceph.conf 2024-09-17T09:12:22.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:21 smithi179 ceph-mon[27782]: Updating smithi179:/etc/ceph/ceph.conf 2024-09-17T09:12:22.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:21 smithi179 ceph-mon[27782]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:21 smithi179 ceph-mon[27782]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:21 smithi179 ceph-mon[27782]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-17T09:12:22.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:21 smithi179 ceph-mon[27782]: mgrmap e19: y(active, since 1.01588s), standbys: z, x 2024-09-17T09:12:22.827 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:12:22.828 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":32,"fsid":"3dd20088-74d4-11ef-bceb-c7b262605968","created":"2024-09-17T09:08:23.498441+0000","modified":"2024-09-17T09:12:20.413863+0000","last_up_change":"2024-09-17T09:11:36.632115+0000","last_in_change":"2024-09-17T09:11:18.155400+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T09:11:38.133300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3,"score_stable":3,"optimal_score":1,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-09-17T09:11:50.464867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-09-17T09:11:52.569726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.control","create_time":"2024-09-17T09:11:54.549579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.meta","create_time":"2024-09-17T09:11:56.620716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"684fe44c-84df-450d-89af-befb1a2bffe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6803","nonce":2756799953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6805","nonce":2756799953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6809","nonce":2756799953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":2756799953},{"type":"v1","addr":"172.21.15.42:6807","nonce":2756799953}]},"public_addr":"172.21.15.42:6803/2756799953","cluster_addr":"172.21.15.42:6805/2756799953","heartbeat_back_addr":"172.21.15.42:6809/2756799953","heartbeat_front_addr":"172.21.15.42:6807/2756799953","state":["exists","up"]},{"osd":1,"uuid":"cc71e050-4540-485d-8d4b-0ddd804e106d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6801","nonce":1794465620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6803","nonce":1794465620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6807","nonce":1794465620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1794465620},{"type":"v1","addr":"172.21.15.161:6805","nonce":1794465620}]},"public_addr":"172.21.15.161:6801/1794465620","cluster_addr":"172.21.15.161:6803/1794465620","heartbeat_back_addr":"172.21.15.161:6807/1794465620","heartbeat_front_addr":"172.21.15.161:6805/1794465620","state":["exists","up"]},{"osd":2,"uuid":"69b94f3d-842c-464e-af5a-36fdbc243f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6801","nonce":871554272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6803","nonce":871554272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6807","nonce":871554272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":871554272},{"type":"v1","addr":"172.21.15.179:6805","nonce":871554272}]},"public_addr":"172.21.15.179:6801/871554272","cluster_addr":"172.21.15.179:6803/871554272","heartbeat_back_addr":"172.21.15.179:6807/871554272","heartbeat_front_addr":"172.21.15.179:6805/871554272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:10:46.656253+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:11:11.242023+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T09:11:34.753972+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:0/206545066":"2024-09-18T09:12:20.413831+0000","172.21.15.42:0/4101290312":"2024-09-18T09:12:20.413831+0000","172.21.15.42:0/1705199431":"2024-09-18T09:12:20.413831+0000","172.21.15.42:6800/1234820444":"2024-09-18T09:08:45.988132+0000","172.21.15.42:0/3276664722":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6801/1922140672":"2024-09-18T09:09:09.624408+0000","172.21.15.42:6800/1922140672":"2024-09-18T09:09:09.624408+0000","172.21.15.42:6801/1234820444":"2024-09-18T09:08:45.988132+0000","172.21.15.42:0/1593864090":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6801/2286834207":"2024-09-18T09:12:20.413831+0000","172.21.15.42:0/2653202478":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3337791658":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/3199620492":"2024-09-18T09:08:45.988132+0000","172.21.15.42:6800/2286834207":"2024-09-18T09:12:20.413831+0000","172.21.15.42:0/2020475853":"2024-09-18T09:09:09.624408+0000","172.21.15.42:0/605601305":"2024-09-18T09:12:20.413831+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T09:12:22.828 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:22.533+0000 7f9e2b5a6640 -1 log_channel(cephadm) log [ERR] : [17/Sep/2024:09:12:22] ENGINE Error in HTTPServer.serve 2024-09-17T09:12:22.828 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: Traceback (most recent call last): 2024-09-17T09:12:22.828 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:12:22.828 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._connections.run(self.expiration_interval) 2024-09-17T09:12:22.828 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:12:22.828 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._run(expiration_interval) 2024-09-17T09:12:22.828 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: s = self.context.wrap_socket( 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: return self.sslsocket_class._create( 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self.do_handshake() 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: self._sslobj.do_handshake() 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:12:22.829 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:12:22.830 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ::ffff:172.21.15.161 - - [17/Sep/2024:09:12:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: pgmap v3: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.158 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: Deploying daemon alertmanager.a on smithi042 2024-09-17T09:12:23.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: [17/Sep/2024:09:12:22] ENGINE Bus STARTING 2024-09-17T09:12:23.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: [17/Sep/2024:09:12:22] ENGINE Serving on http://172.21.15.42:8765 2024-09-17T09:12:23.159 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:22 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/1795269225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:12:23.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: pgmap v3: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:23.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: Deploying daemon alertmanager.a on smithi042 2024-09-17T09:12:23.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: [17/Sep/2024:09:12:22] ENGINE Bus STARTING 2024-09-17T09:12:23.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: [17/Sep/2024:09:12:22] ENGINE Serving on http://172.21.15.42:8765 2024-09-17T09:12:23.270 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:22 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/1795269225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: pgmap v3: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: Updating smithi179:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: Updating smithi161:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: Updating smithi042:/etc/ceph/ceph.client.admin.keyring 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: Updating smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: Updating smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: Updating smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: Deploying daemon alertmanager.a on smithi042 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: [17/Sep/2024:09:12:22] ENGINE Bus STARTING 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: [17/Sep/2024:09:12:22] ENGINE Serving on http://172.21.15.42:8765 2024-09-17T09:12:23.280 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:22 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/1795269225' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-17T09:12:23.599 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-17T09:12:23.599 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-17T09:12:23.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-17T09:12:23.818 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:23.829 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:23.831 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:24.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:24 smithi042 ceph-mon[25899]: pgmap v4: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:24.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:24 smithi042 ceph-mon[25899]: [17/Sep/2024:09:12:22] ENGINE Serving on https://172.21.15.42:7151 2024-09-17T09:12:24.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:24 smithi042 ceph-mon[25899]: [17/Sep/2024:09:12:22] ENGINE Bus STARTED 2024-09-17T09:12:24.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:24 smithi042 ceph-mon[25899]: [17/Sep/2024:09:12:22] ENGINE Error in HTTPServer.serve 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: Traceback (most recent call last): 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._connections.run(self.expiration_interval) 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._run(expiration_interval) 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: s = self.context.wrap_socket( 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: return self.sslsocket_class._create( 2024-09-17T09:12:24.225 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:12:24.226 INFO:journalctl@ceph.mon.a.smithi042.stdout: self.do_handshake() 2024-09-17T09:12:24.226 INFO:journalctl@ceph.mon.a.smithi042.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:12:24.226 INFO:journalctl@ceph.mon.a.smithi042.stdout: self._sslobj.do_handshake() 2024-09-17T09:12:24.226 INFO:journalctl@ceph.mon.a.smithi042.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:12:24.226 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:24 smithi042 ceph-mon[25899]: mgrmap e20: y(active, since 2s), standbys: z, x 2024-09-17T09:12:24.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:24 smithi161 ceph-mon[27677]: pgmap v4: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:24.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:24 smithi161 ceph-mon[27677]: [17/Sep/2024:09:12:22] ENGINE Serving on https://172.21.15.42:7151 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:24 smithi161 ceph-mon[27677]: [17/Sep/2024:09:12:22] ENGINE Bus STARTED 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:24 smithi161 ceph-mon[27677]: [17/Sep/2024:09:12:22] ENGINE Error in HTTPServer.serve 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: Traceback (most recent call last): 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: self._connections.run(self.expiration_interval) 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: self._run(expiration_interval) 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:12:24.519 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: s = self.context.wrap_socket( 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: return self.sslsocket_class._create( 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: self.do_handshake() 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: self._sslobj.do_handshake() 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:12:24.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:24 smithi161 ceph-mon[27677]: mgrmap e20: y(active, since 2s), standbys: z, x 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:24 smithi179 ceph-mon[27782]: pgmap v4: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:24 smithi179 ceph-mon[27782]: [17/Sep/2024:09:12:22] ENGINE Serving on https://172.21.15.42:7151 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:24 smithi179 ceph-mon[27782]: [17/Sep/2024:09:12:22] ENGINE Bus STARTED 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:24 smithi179 ceph-mon[27782]: [17/Sep/2024:09:12:22] ENGINE Error in HTTPServer.serve 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout: Traceback (most recent call last): 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout: self._connections.run(self.expiration_interval) 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-17T09:12:24.529 INFO:journalctl@ceph.mon.c.smithi179.stdout: self._run(expiration_interval) 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: s = self.context.wrap_socket( 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: return self.sslsocket_class._create( 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: self.do_handshake() 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: self._sslobj.do_handshake() 2024-09-17T09:12:24.530 INFO:journalctl@ceph.mon.c.smithi179.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-17T09:12:24.531 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:24 smithi179 ceph-mon[27782]: mgrmap e20: y(active, since 2s), standbys: z, x 2024-09-17T09:12:26.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:26 smithi042 ceph-mon[25899]: pgmap v5: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:26.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:26 smithi042 ceph-mon[25899]: mgrmap e21: y(active, since 4s), standbys: z, x 2024-09-17T09:12:26.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:26 smithi161 ceph-mon[27677]: pgmap v5: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:26.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:26 smithi161 ceph-mon[27677]: mgrmap e21: y(active, since 4s), standbys: z, x 2024-09-17T09:12:26.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:26 smithi179 ceph-mon[27782]: pgmap v5: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:26.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:26 smithi179 ceph-mon[27782]: mgrmap e21: y(active, since 4s), standbys: z, x 2024-09-17T09:12:28.416 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:28 smithi042 ceph-mon[25899]: pgmap v6: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:28.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:28 smithi161 ceph-mon[27677]: pgmap v6: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:28.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:28 smithi179 ceph-mon[27782]: pgmap v6: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:30.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:30 smithi179 ceph-mon[27782]: pgmap v7: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T09:12:30.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:30 smithi042 ceph-mon[25899]: pgmap v7: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T09:12:30.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:30 smithi161 ceph-mon[27677]: pgmap v7: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-17T09:12:31.788 INFO:teuthology.orchestra.run.smithi042.stdout:77309411339 2024-09-17T09:12:31.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-17T09:12:32.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:32 smithi161 ceph-mon[27677]: pgmap v8: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-17T09:12:32.399 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:32 smithi042 ceph-mon[25899]: pgmap v8: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-17T09:12:32.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:32 smithi179 ceph-mon[27782]: pgmap v8: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-17T09:12:32.775 INFO:teuthology.orchestra.run.smithi042.stdout:34359738391 2024-09-17T09:12:32.775 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-17T09:12:32.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:32 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ::ffff:172.21.15.161 - - [17/Sep/2024:09:12:32] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:33.792 INFO:teuthology.orchestra.run.smithi042.stdout:55834574866 2024-09-17T09:12:33.792 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-17T09:12:34.407 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:34 smithi042 ceph-mon[25899]: pgmap v9: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T09:12:34.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:34 smithi161 ceph-mon[27677]: pgmap v9: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T09:12:34.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:34 smithi179 ceph-mon[27782]: pgmap v9: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-17T09:12:35.161 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:35.164 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:36.098 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:36.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:36 smithi042 ceph-mon[25899]: pgmap v10: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:36.211 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:36 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:36.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:36 smithi161 ceph-mon[27677]: pgmap v10: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:36.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:36 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:36.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:36 smithi179 ceph-mon[27782]: pgmap v10: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:36.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:36 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:38.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:38 smithi042 ceph-mon[25899]: pgmap v11: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:38.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:38 smithi161 ceph-mon[27677]: pgmap v11: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:38.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:38 smithi179 ceph-mon[27782]: pgmap v11: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:39.222 INFO:teuthology.orchestra.run.smithi042.stdout:77309411341 2024-09-17T09:12:39.254 INFO:teuthology.orchestra.run.smithi042.stdout:34359738393 2024-09-17T09:12:39.913 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738391 got 34359738393 for osd.0 2024-09-17T09:12:39.913 DEBUG:teuthology.parallel:result is None 2024-09-17T09:12:40.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:40 smithi042 ceph-mon[25899]: pgmap v12: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:40.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:40 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/440797365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T09:12:40.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:40 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3190420889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T09:12:40.290 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411339 got 77309411341 for osd.2 2024-09-17T09:12:40.290 DEBUG:teuthology.parallel:result is None 2024-09-17T09:12:40.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:40 smithi161 ceph-mon[27677]: pgmap v12: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:40.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:40 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/440797365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T09:12:40.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:40 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3190420889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T09:12:40.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:40 smithi179 ceph-mon[27782]: pgmap v12: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-17T09:12:40.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:40 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/440797365' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-17T09:12:40.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:40 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3190420889' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-17T09:12:40.944 INFO:teuthology.orchestra.run.smithi042.stdout:55834574868 2024-09-17T09:12:41.171 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:41 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/2900026745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T09:12:41.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:41 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/2900026745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T09:12:41.528 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:41 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/2900026745' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-17T09:12:41.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574866 got 55834574868 for osd.1 2024-09-17T09:12:41.689 DEBUG:teuthology.parallel:result is None 2024-09-17T09:12:41.689 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-17T09:12:41.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T09:12:41.974 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:12:41 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a[46472]: ts=2024-09-17T09:12:41.903Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-09-17T09:12:42.395 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:42] ENGINE Bus STOPPING 2024-09-17T09:12:42.396 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:12:42 smithi042 bash[46409]: cd569a324b62218d237f20c0e757b2d05cc46b0727d6ffc26c88d59261d445b3 2024-09-17T09:12:42.396 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:12:42 smithi042 systemd[1]: Started Ceph alertmanager.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:12:42.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-mon[25899]: pgmap v13: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:42.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.396 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:42 smithi161 ceph-mon[27677]: pgmap v13: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:42.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:42 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:42 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:42 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:42 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:42 smithi179 ceph-mon[27782]: pgmap v13: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:42.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:42 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:42 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:42 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:42 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:42.551 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:42.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ::ffff:172.21.15.161 - - [17/Sep/2024:09:12:42] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:42.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:42] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T09:12:42.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:42] ENGINE Bus STOPPED 2024-09-17T09:12:42.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:42] ENGINE Bus STARTING 2024-09-17T09:12:42.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:42] ENGINE Serving on http://:::9283 2024-09-17T09:12:42.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:42 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:12:42] ENGINE Bus STARTED 2024-09-17T09:12:43.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-mon[25899]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T09:12:43.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T09:12:43.284 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-mon[25899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T09:12:43.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.285 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-mon[25899]: Deploying daemon grafana.a on smithi161 2024-09-17T09:12:43.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:43 smithi161 ceph-mon[27677]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T09:12:43.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:43 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:43 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:43 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T09:12:43.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:43 smithi161 ceph-mon[27677]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T09:12:43.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:43 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:43 smithi161 ceph-mon[27677]: Deploying daemon grafana.a on smithi161 2024-09-17T09:12:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:43 smithi179 ceph-mon[27782]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-17T09:12:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:43 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:43 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:43 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T09:12:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:43 smithi179 ceph-mon[27782]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-17T09:12:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:43 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:43.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:43 smithi179 ceph-mon[27782]: Deploying daemon grafana.a on smithi161 2024-09-17T09:12:44.130 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:12:43 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a[46472]: ts=2024-09-17T09:12:43.877Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000249104s 2024-09-17T09:12:44.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:44 smithi042 ceph-mon[25899]: pgmap v14: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:44.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:44 smithi161 ceph-mon[27677]: pgmap v14: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:44.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:44 smithi179 ceph-mon[27782]: pgmap v14: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:45.441 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:12:45.442 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T09:12:46.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:46 smithi042 ceph-mon[25899]: pgmap v15: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:46.286 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:46 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:46.308 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2024-09-17T09:12:44.432857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595838,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":962,"num_read_kb":809,"num_write":691,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":387,"acting":387,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":387,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281223168,"kb_used":100528,"kb_used_data":3084,"kb_used_omap":4,"kb_used_meta":97403,"kb_avail":281122640,"statfs":{"total":287972524032,"available":287869583360,"internally_reserved":0,"allocated":3158016,"data_stored":2109084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":99741010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002862"},"pg_stats":[{"pgid":"2.1f","version":"24'1","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.248469+0000","last_change":"2024-09-17T09:11:52.108332+0000","last_active":"2024-09-17T09:11:59.248469+0000","last_peered":"2024-09-17T09:11:59.248469+0000","last_clean":"2024-09-17T09:11:59.248469+0000","last_became_active":"2024-09-17T09:11:52.107676+0000","last_became_peered":"2024-09-17T09:11:52.107676+0000","last_unstale":"2024-09-17T09:11:59.248469+0000","last_undegraded":"2024-09-17T09:11:59.248469+0000","last_fullsized":"2024-09-17T09:11:59.248469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:19.073428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.466540+0000","last_change":"2024-09-17T09:11:54.116966+0000","last_active":"2024-09-17T09:11:59.466540+0000","last_peered":"2024-09-17T09:11:59.466540+0000","last_clean":"2024-09-17T09:11:59.466540+0000","last_became_active":"2024-09-17T09:11:54.116385+0000","last_became_peered":"2024-09-17T09:11:54.116385+0000","last_unstale":"2024-09-17T09:11:59.466540+0000","last_undegraded":"2024-09-17T09:11:59.466540+0000","last_fullsized":"2024-09-17T09:11:59.466540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:26.105442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135262+0000","last_change":"2024-09-17T09:11:56.125610+0000","last_active":"2024-09-17T09:11:59.135262+0000","last_peered":"2024-09-17T09:11:59.135262+0000","last_clean":"2024-09-17T09:11:59.135262+0000","last_became_active":"2024-09-17T09:11:56.125330+0000","last_became_peered":"2024-09-17T09:11:56.125330+0000","last_unstale":"2024-09-17T09:11:59.135262+0000","last_undegraded":"2024-09-17T09:11:59.135262+0000","last_fullsized":"2024-09-17T09:11:59.135262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:12.961337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134754+0000","last_change":"2024-09-17T09:11:58.144993+0000","last_active":"2024-09-17T09:11:59.134754+0000","last_peered":"2024-09-17T09:11:59.134754+0000","last_clean":"2024-09-17T09:11:59.134754+0000","last_became_active":"2024-09-17T09:11:58.144638+0000","last_became_peered":"2024-09-17T09:11:58.144638+0000","last_unstale":"2024-09-17T09:11:59.134754+0000","last_undegraded":"2024-09-17T09:11:59.134754+0000","last_fullsized":"2024-09-17T09:11:59.134754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:34.072483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.259026+0000","last_change":"2024-09-17T09:11:52.108798+0000","last_active":"2024-09-17T09:11:59.259026+0000","last_peered":"2024-09-17T09:11:59.259026+0000","last_clean":"2024-09-17T09:11:59.259026+0000","last_became_active":"2024-09-17T09:11:52.107590+0000","last_became_peered":"2024-09-17T09:11:52.107590+0000","last_unstale":"2024-09-17T09:11:59.259026+0000","last_undegraded":"2024-09-17T09:11:59.259026+0000","last_fullsized":"2024-09-17T09:11:59.259026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:36.840048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.472929+0000","last_change":"2024-09-17T09:11:54.116793+0000","last_active":"2024-09-17T09:11:59.472929+0000","last_peered":"2024-09-17T09:11:59.472929+0000","last_clean":"2024-09-17T09:11:59.472929+0000","last_became_active":"2024-09-17T09:11:54.115159+0000","last_became_peered":"2024-09-17T09:11:54.115159+0000","last_unstale":"2024-09-17T09:11:59.472929+0000","last_undegraded":"2024-09-17T09:11:59.472929+0000","last_fullsized":"2024-09-17T09:11:59.472929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:20.180075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134961+0000","last_change":"2024-09-17T09:11:56.131250+0000","last_active":"2024-09-17T09:11:59.134961+0000","last_peered":"2024-09-17T09:11:59.134961+0000","last_clean":"2024-09-17T09:11:59.134961+0000","last_became_active":"2024-09-17T09:11:56.130901+0000","last_became_peered":"2024-09-17T09:11:56.130901+0000","last_unstale":"2024-09-17T09:11:59.134961+0000","last_undegraded":"2024-09-17T09:11:59.134961+0000","last_fullsized":"2024-09-17T09:11:59.134961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:54.303762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249305+0000","last_change":"2024-09-17T09:11:58.144707+0000","last_active":"2024-09-17T09:11:59.249305+0000","last_peered":"2024-09-17T09:11:59.249305+0000","last_clean":"2024-09-17T09:11:59.249305+0000","last_became_active":"2024-09-17T09:11:58.144266+0000","last_became_peered":"2024-09-17T09:11:58.144266+0000","last_unstale":"2024-09-17T09:11:59.249305+0000","last_undegraded":"2024-09-17T09:11:59.249305+0000","last_fullsized":"2024-09-17T09:11:59.249305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:06:08.852933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136511+0000","last_change":"2024-09-17T09:11:52.108792+0000","last_active":"2024-09-17T09:11:59.136511+0000","last_peered":"2024-09-17T09:11:59.136511+0000","last_clean":"2024-09-17T09:11:59.136511+0000","last_became_active":"2024-09-17T09:11:52.108457+0000","last_became_peered":"2024-09-17T09:11:52.108457+0000","last_unstale":"2024-09-17T09:11:59.136511+0000","last_undegraded":"2024-09-17T09:11:59.136511+0000","last_fullsized":"2024-09-17T09:11:59.136511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:47.338321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.412938+0000","last_change":"2024-09-17T09:11:54.118958+0000","last_active":"2024-09-17T09:11:59.412938+0000","last_peered":"2024-09-17T09:11:59.412938+0000","last_clean":"2024-09-17T09:11:59.412938+0000","last_became_active":"2024-09-17T09:11:54.118483+0000","last_became_peered":"2024-09-17T09:11:54.118483+0000","last_unstale":"2024-09-17T09:11:59.412938+0000","last_undegraded":"2024-09-17T09:11:59.412938+0000","last_fullsized":"2024-09-17T09:11:59.412938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:41.538638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136741+0000","last_change":"2024-09-17T09:11:56.127332+0000","last_active":"2024-09-17T09:11:59.136741+0000","last_peered":"2024-09-17T09:11:59.136741+0000","last_clean":"2024-09-17T09:11:59.136741+0000","last_became_active":"2024-09-17T09:11:56.125155+0000","last_became_peered":"2024-09-17T09:11:56.125155+0000","last_unstale":"2024-09-17T09:11:59.136741+0000","last_undegraded":"2024-09-17T09:11:59.136741+0000","last_fullsized":"2024-09-17T09:11:59.136741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:13.502596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648188+0000","last_change":"2024-09-17T09:11:58.145408+0000","last_active":"2024-09-17T09:12:01.648188+0000","last_peered":"2024-09-17T09:12:01.648188+0000","last_clean":"2024-09-17T09:12:01.648188+0000","last_became_active":"2024-09-17T09:11:58.145200+0000","last_became_peered":"2024-09-17T09:11:58.145200+0000","last_unstale":"2024-09-17T09:12:01.648188+0000","last_undegraded":"2024-09-17T09:12:01.648188+0000","last_fullsized":"2024-09-17T09:12:01.648188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:50.676935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135452+0000","last_change":"2024-09-17T09:11:52.108034+0000","last_active":"2024-09-17T09:11:59.135452+0000","last_peered":"2024-09-17T09:11:59.135452+0000","last_clean":"2024-09-17T09:11:59.135452+0000","last_became_active":"2024-09-17T09:11:52.107705+0000","last_became_peered":"2024-09-17T09:11:52.107705+0000","last_unstale":"2024-09-17T09:11:59.135452+0000","last_undegraded":"2024-09-17T09:11:59.135452+0000","last_fullsized":"2024-09-17T09:11:59.135452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:41.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"31'12","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.479211+0000","last_change":"2024-09-17T09:11:54.119311+0000","last_active":"2024-09-17T09:11:59.479211+0000","last_peered":"2024-09-17T09:11:59.479211+0000","last_clean":"2024-09-17T09:11:59.479211+0000","last_became_active":"2024-09-17T09:11:54.119084+0000","last_became_peered":"2024-09-17T09:11:54.119084+0000","last_unstale":"2024-09-17T09:11:59.479211+0000","last_undegraded":"2024-09-17T09:11:59.479211+0000","last_fullsized":"2024-09-17T09:11:59.479211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:24:16.210821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136287+0000","last_change":"2024-09-17T09:11:56.130110+0000","last_active":"2024-09-17T09:11:59.136287+0000","last_peered":"2024-09-17T09:11:59.136287+0000","last_clean":"2024-09-17T09:11:59.136287+0000","last_became_active":"2024-09-17T09:11:56.129801+0000","last_became_peered":"2024-09-17T09:11:56.129801+0000","last_unstale":"2024-09-17T09:11:59.136287+0000","last_undegraded":"2024-09-17T09:11:59.136287+0000","last_fullsized":"2024-09-17T09:11:59.136287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:48.546808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135896+0000","last_change":"2024-09-17T09:11:58.143247+0000","last_active":"2024-09-17T09:11:59.135896+0000","last_peered":"2024-09-17T09:11:59.135896+0000","last_clean":"2024-09-17T09:11:59.135896+0000","last_became_active":"2024-09-17T09:11:58.142465+0000","last_became_peered":"2024-09-17T09:11:58.142465+0000","last_unstale":"2024-09-17T09:11:59.135896+0000","last_undegraded":"2024-09-17T09:11:59.135896+0000","last_fullsized":"2024-09-17T09:11:59.135896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:53:35.335362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'19","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.483223+0000","last_change":"2024-09-17T09:11:54.119005+0000","last_active":"2024-09-17T09:11:59.483223+0000","last_peered":"2024-09-17T09:11:59.483223+0000","last_clean":"2024-09-17T09:11:59.483223+0000","last_became_active":"2024-09-17T09:11:54.118566+0000","last_became_peered":"2024-09-17T09:11:54.118566+0000","last_unstale":"2024-09-17T09:11:59.483223+0000","last_undegraded":"2024-09-17T09:11:59.483223+0000","last_fullsized":"2024-09-17T09:11:59.483223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:53.657629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135277+0000","last_change":"2024-09-17T09:11:52.108687+0000","last_active":"2024-09-17T09:11:59.135277+0000","last_peered":"2024-09-17T09:11:59.135277+0000","last_clean":"2024-09-17T09:11:59.135277+0000","last_became_active":"2024-09-17T09:11:52.108371+0000","last_became_peered":"2024-09-17T09:11:52.108371+0000","last_unstale":"2024-09-17T09:11:59.135277+0000","last_undegraded":"2024-09-17T09:11:59.135277+0000","last_fullsized":"2024-09-17T09:11:59.135277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:43.904432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036563+0000","last_change":"2024-09-17T09:11:56.129540+0000","last_active":"2024-09-17T09:12:35.036563+0000","last_peered":"2024-09-17T09:12:35.036563+0000","last_clean":"2024-09-17T09:12:35.036563+0000","last_became_active":"2024-09-17T09:11:56.128967+0000","last_became_peered":"2024-09-17T09:11:56.128967+0000","last_unstale":"2024-09-17T09:12:35.036563+0000","last_undegraded":"2024-09-17T09:12:35.036563+0000","last_fullsized":"2024-09-17T09:12:35.036563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:31.886371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249563+0000","last_change":"2024-09-17T09:11:58.143095+0000","last_active":"2024-09-17T09:11:59.249563+0000","last_peered":"2024-09-17T09:11:59.249563+0000","last_clean":"2024-09-17T09:11:59.249563+0000","last_became_active":"2024-09-17T09:11:58.142437+0000","last_became_peered":"2024-09-17T09:11:58.142437+0000","last_unstale":"2024-09-17T09:11:59.249563+0000","last_undegraded":"2024-09-17T09:11:59.249563+0000","last_fullsized":"2024-09-17T09:11:59.249563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:44.158114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.444616+0000","last_change":"2024-09-17T09:11:54.116797+0000","last_active":"2024-09-17T09:11:59.444616+0000","last_peered":"2024-09-17T09:11:59.444616+0000","last_clean":"2024-09-17T09:11:59.444616+0000","last_became_active":"2024-09-17T09:11:54.116116+0000","last_became_peered":"2024-09-17T09:11:54.116116+0000","last_unstale":"2024-09-17T09:11:59.444616+0000","last_undegraded":"2024-09-17T09:11:59.444616+0000","last_fullsized":"2024-09-17T09:11:59.444616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:38:24.794905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135073+0000","last_change":"2024-09-17T09:11:52.111537+0000","last_active":"2024-09-17T09:11:59.135073+0000","last_peered":"2024-09-17T09:11:59.135073+0000","last_clean":"2024-09-17T09:11:59.135073+0000","last_became_active":"2024-09-17T09:11:52.111321+0000","last_became_peered":"2024-09-17T09:11:52.111321+0000","last_unstale":"2024-09-17T09:11:59.135073+0000","last_undegraded":"2024-09-17T09:11:59.135073+0000","last_fullsized":"2024-09-17T09:11:59.135073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:55.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136970+0000","last_change":"2024-09-17T09:11:56.127881+0000","last_active":"2024-09-17T09:11:59.136970+0000","last_peered":"2024-09-17T09:11:59.136970+0000","last_clean":"2024-09-17T09:11:59.136970+0000","last_became_active":"2024-09-17T09:11:56.127278+0000","last_became_peered":"2024-09-17T09:11:56.127278+0000","last_unstale":"2024-09-17T09:11:59.136970+0000","last_undegraded":"2024-09-17T09:11:59.136970+0000","last_fullsized":"2024-09-17T09:11:59.136970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:53.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648395+0000","last_change":"2024-09-17T09:11:58.148998+0000","last_active":"2024-09-17T09:12:01.648395+0000","last_peered":"2024-09-17T09:12:01.648395+0000","last_clean":"2024-09-17T09:12:01.648395+0000","last_became_active":"2024-09-17T09:11:58.148742+0000","last_became_peered":"2024-09-17T09:11:58.148742+0000","last_unstale":"2024-09-17T09:12:01.648395+0000","last_undegraded":"2024-09-17T09:12:01.648395+0000","last_fullsized":"2024-09-17T09:12:01.648395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:20.881408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.419216+0000","last_change":"2024-09-17T09:11:54.120285+0000","last_active":"2024-09-17T09:11:59.419216+0000","last_peered":"2024-09-17T09:11:59.419216+0000","last_clean":"2024-09-17T09:11:59.419216+0000","last_became_active":"2024-09-17T09:11:54.120027+0000","last_became_peered":"2024-09-17T09:11:54.120027+0000","last_unstale":"2024-09-17T09:11:59.419216+0000","last_undegraded":"2024-09-17T09:11:59.419216+0000","last_fullsized":"2024-09-17T09:11:59.419216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.264767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134544+0000","last_change":"2024-09-17T09:11:52.109155+0000","last_active":"2024-09-17T09:11:59.134544+0000","last_peered":"2024-09-17T09:11:59.134544+0000","last_clean":"2024-09-17T09:11:59.134544+0000","last_became_active":"2024-09-17T09:11:52.107555+0000","last_became_peered":"2024-09-17T09:11:52.107555+0000","last_unstale":"2024-09-17T09:11:59.134544+0000","last_undegraded":"2024-09-17T09:11:59.134544+0000","last_fullsized":"2024-09-17T09:11:59.134544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:19.131412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249870+0000","last_change":"2024-09-17T09:11:56.127696+0000","last_active":"2024-09-17T09:11:59.249870+0000","last_peered":"2024-09-17T09:11:59.249870+0000","last_clean":"2024-09-17T09:11:59.249870+0000","last_became_active":"2024-09-17T09:11:56.127370+0000","last_became_peered":"2024-09-17T09:11:56.127370+0000","last_unstale":"2024-09-17T09:11:59.249870+0000","last_undegraded":"2024-09-17T09:11:59.249870+0000","last_fullsized":"2024-09-17T09:11:59.249870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:47.876475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648418+0000","last_change":"2024-09-17T09:11:58.148661+0000","last_active":"2024-09-17T09:12:01.648418+0000","last_peered":"2024-09-17T09:12:01.648418+0000","last_clean":"2024-09-17T09:12:01.648418+0000","last_became_active":"2024-09-17T09:11:58.148383+0000","last_became_peered":"2024-09-17T09:11:58.148383+0000","last_unstale":"2024-09-17T09:12:01.648418+0000","last_undegraded":"2024-09-17T09:12:01.648418+0000","last_fullsized":"2024-09-17T09:12:01.648418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:17.143882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'12","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.296709+0000","last_change":"2024-09-17T09:11:54.119916+0000","last_active":"2024-09-17T09:11:59.296709+0000","last_peered":"2024-09-17T09:11:59.296709+0000","last_clean":"2024-09-17T09:11:59.296709+0000","last_became_active":"2024-09-17T09:11:54.119639+0000","last_became_peered":"2024-09-17T09:11:54.119639+0000","last_unstale":"2024-09-17T09:11:59.296709+0000","last_undegraded":"2024-09-17T09:11:59.296709+0000","last_fullsized":"2024-09-17T09:11:59.296709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:13.241739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135297+0000","last_change":"2024-09-17T09:11:52.109233+0000","last_active":"2024-09-17T09:11:59.135297+0000","last_peered":"2024-09-17T09:11:59.135297+0000","last_clean":"2024-09-17T09:11:59.135297+0000","last_became_active":"2024-09-17T09:11:52.108359+0000","last_became_peered":"2024-09-17T09:11:52.108359+0000","last_unstale":"2024-09-17T09:11:59.135297+0000","last_undegraded":"2024-09-17T09:11:59.135297+0000","last_fullsized":"2024-09-17T09:11:59.135297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:13:20.127415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036605+0000","last_change":"2024-09-17T09:11:56.131285+0000","last_active":"2024-09-17T09:12:35.036605+0000","last_peered":"2024-09-17T09:12:35.036605+0000","last_clean":"2024-09-17T09:12:35.036605+0000","last_became_active":"2024-09-17T09:11:56.130892+0000","last_became_peered":"2024-09-17T09:11:56.130892+0000","last_unstale":"2024-09-17T09:12:35.036605+0000","last_undegraded":"2024-09-17T09:12:35.036605+0000","last_fullsized":"2024-09-17T09:12:35.036605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:24:50.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136221+0000","last_change":"2024-09-17T09:11:58.143274+0000","last_active":"2024-09-17T09:11:59.136221+0000","last_peered":"2024-09-17T09:11:59.136221+0000","last_clean":"2024-09-17T09:11:59.136221+0000","last_became_active":"2024-09-17T09:11:58.142719+0000","last_became_peered":"2024-09-17T09:11:58.142719+0000","last_unstale":"2024-09-17T09:11:59.136221+0000","last_undegraded":"2024-09-17T09:11:59.136221+0000","last_fullsized":"2024-09-17T09:11:59.136221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:01.641449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.410876+0000","last_change":"2024-09-17T09:11:54.116843+0000","last_active":"2024-09-17T09:11:59.410876+0000","last_peered":"2024-09-17T09:11:59.410876+0000","last_clean":"2024-09-17T09:11:59.410876+0000","last_became_active":"2024-09-17T09:11:54.116100+0000","last_became_peered":"2024-09-17T09:11:54.116100+0000","last_unstale":"2024-09-17T09:11:59.410876+0000","last_undegraded":"2024-09-17T09:11:59.410876+0000","last_fullsized":"2024-09-17T09:11:59.410876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:37.435673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136222+0000","last_change":"2024-09-17T09:11:52.109208+0000","last_active":"2024-09-17T09:11:59.136222+0000","last_peered":"2024-09-17T09:11:59.136222+0000","last_clean":"2024-09-17T09:11:59.136222+0000","last_became_active":"2024-09-17T09:11:52.108367+0000","last_became_peered":"2024-09-17T09:11:52.108367+0000","last_unstale":"2024-09-17T09:11:59.136222+0000","last_undegraded":"2024-09-17T09:11:59.136222+0000","last_fullsized":"2024-09-17T09:11:59.136222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:50.868544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135435+0000","last_change":"2024-09-17T09:11:56.125875+0000","last_active":"2024-09-17T09:11:59.135435+0000","last_peered":"2024-09-17T09:11:59.135435+0000","last_clean":"2024-09-17T09:11:59.135435+0000","last_became_active":"2024-09-17T09:11:56.125582+0000","last_became_peered":"2024-09-17T09:11:56.125582+0000","last_unstale":"2024-09-17T09:11:59.135435+0000","last_undegraded":"2024-09-17T09:11:59.135435+0000","last_fullsized":"2024-09-17T09:11:59.135435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:59.674162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648115+0000","last_change":"2024-09-17T09:11:58.148943+0000","last_active":"2024-09-17T09:12:01.648115+0000","last_peered":"2024-09-17T09:12:01.648115+0000","last_clean":"2024-09-17T09:12:01.648115+0000","last_became_active":"2024-09-17T09:11:58.148537+0000","last_became_peered":"2024-09-17T09:11:58.148537+0000","last_unstale":"2024-09-17T09:12:01.648115+0000","last_undegraded":"2024-09-17T09:12:01.648115+0000","last_fullsized":"2024-09-17T09:12:01.648115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:08:36.622057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'13","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.400645+0000","last_change":"2024-09-17T09:11:54.116855+0000","last_active":"2024-09-17T09:11:59.400645+0000","last_peered":"2024-09-17T09:11:59.400645+0000","last_clean":"2024-09-17T09:11:59.400645+0000","last_became_active":"2024-09-17T09:11:54.116421+0000","last_became_peered":"2024-09-17T09:11:54.116421+0000","last_unstale":"2024-09-17T09:11:59.400645+0000","last_undegraded":"2024-09-17T09:11:59.400645+0000","last_fullsized":"2024-09-17T09:11:59.400645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:21.005192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136768+0000","last_change":"2024-09-17T09:11:52.108950+0000","last_active":"2024-09-17T09:11:59.136768+0000","last_peered":"2024-09-17T09:11:59.136768+0000","last_clean":"2024-09-17T09:11:59.136768+0000","last_became_active":"2024-09-17T09:11:52.108382+0000","last_became_peered":"2024-09-17T09:11:52.108382+0000","last_unstale":"2024-09-17T09:11:59.136768+0000","last_undegraded":"2024-09-17T09:11:59.136768+0000","last_fullsized":"2024-09-17T09:11:59.136768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:32.433107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"31'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036358+0000","last_change":"2024-09-17T09:11:56.129229+0000","last_active":"2024-09-17T09:12:35.036358+0000","last_peered":"2024-09-17T09:12:35.036358+0000","last_clean":"2024-09-17T09:12:35.036358+0000","last_became_active":"2024-09-17T09:11:56.128623+0000","last_became_peered":"2024-09-17T09:11:56.128623+0000","last_unstale":"2024-09-17T09:12:35.036358+0000","last_undegraded":"2024-09-17T09:12:35.036358+0000","last_fullsized":"2024-09-17T09:12:35.036358+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:42.004345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135539+0000","last_change":"2024-09-17T09:11:58.143109+0000","last_active":"2024-09-17T09:11:59.135539+0000","last_peered":"2024-09-17T09:11:59.135539+0000","last_clean":"2024-09-17T09:11:59.135539+0000","last_became_active":"2024-09-17T09:11:58.141984+0000","last_became_peered":"2024-09-17T09:11:58.141984+0000","last_unstale":"2024-09-17T09:11:59.135539+0000","last_undegraded":"2024-09-17T09:11:59.135539+0000","last_fullsized":"2024-09-17T09:11:59.135539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:50.613933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'28","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036378+0000","last_change":"2024-09-17T09:11:54.116540+0000","last_active":"2024-09-17T09:12:35.036378+0000","last_peered":"2024-09-17T09:12:35.036378+0000","last_clean":"2024-09-17T09:12:35.036378+0000","last_became_active":"2024-09-17T09:11:54.115856+0000","last_became_peered":"2024-09-17T09:11:54.115856+0000","last_unstale":"2024-09-17T09:12:35.036378+0000","last_undegraded":"2024-09-17T09:12:35.036378+0000","last_fullsized":"2024-09-17T09:12:35.036378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:38.399585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135859+0000","last_change":"2024-09-17T09:11:52.112124+0000","last_active":"2024-09-17T09:11:59.135859+0000","last_peered":"2024-09-17T09:11:59.135859+0000","last_clean":"2024-09-17T09:11:59.135859+0000","last_became_active":"2024-09-17T09:11:52.111856+0000","last_became_peered":"2024-09-17T09:11:52.111856+0000","last_unstale":"2024-09-17T09:11:59.135859+0000","last_undegraded":"2024-09-17T09:11:59.135859+0000","last_fullsized":"2024-09-17T09:11:59.135859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:43.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"31'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036610+0000","last_change":"2024-09-17T09:11:56.124835+0000","last_active":"2024-09-17T09:12:35.036610+0000","last_peered":"2024-09-17T09:12:35.036610+0000","last_clean":"2024-09-17T09:12:35.036610+0000","last_became_active":"2024-09-17T09:11:56.124520+0000","last_became_peered":"2024-09-17T09:11:56.124520+0000","last_unstale":"2024-09-17T09:12:35.036610+0000","last_undegraded":"2024-09-17T09:12:35.036610+0000","last_fullsized":"2024-09-17T09:12:35.036610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:34:35.630280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136175+0000","last_change":"2024-09-17T09:11:58.143642+0000","last_active":"2024-09-17T09:11:59.136175+0000","last_peered":"2024-09-17T09:11:59.136175+0000","last_clean":"2024-09-17T09:11:59.136175+0000","last_became_active":"2024-09-17T09:11:58.143266+0000","last_became_peered":"2024-09-17T09:11:58.143266+0000","last_unstale":"2024-09-17T09:11:59.136175+0000","last_undegraded":"2024-09-17T09:11:59.136175+0000","last_fullsized":"2024-09-17T09:11:59.136175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:47:12.764164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'14","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.459740+0000","last_change":"2024-09-17T09:11:54.118976+0000","last_active":"2024-09-17T09:11:59.459740+0000","last_peered":"2024-09-17T09:11:59.459740+0000","last_clean":"2024-09-17T09:11:59.459740+0000","last_became_active":"2024-09-17T09:11:54.118481+0000","last_became_peered":"2024-09-17T09:11:54.118481+0000","last_unstale":"2024-09-17T09:11:59.459740+0000","last_undegraded":"2024-09-17T09:11:59.459740+0000","last_fullsized":"2024-09-17T09:11:59.459740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:43:36.400650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135194+0000","last_change":"2024-09-17T09:11:52.108488+0000","last_active":"2024-09-17T09:11:59.135194+0000","last_peered":"2024-09-17T09:11:59.135194+0000","last_clean":"2024-09-17T09:11:59.135194+0000","last_became_active":"2024-09-17T09:11:52.108213+0000","last_became_peered":"2024-09-17T09:11:52.108213+0000","last_unstale":"2024-09-17T09:11:59.135194+0000","last_undegraded":"2024-09-17T09:11:59.135194+0000","last_fullsized":"2024-09-17T09:11:59.135194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:28:46.762752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135618+0000","last_change":"2024-09-17T09:11:56.126488+0000","last_active":"2024-09-17T09:11:59.135618+0000","last_peered":"2024-09-17T09:11:59.135618+0000","last_clean":"2024-09-17T09:11:59.135618+0000","last_became_active":"2024-09-17T09:11:56.126144+0000","last_became_peered":"2024-09-17T09:11:56.126144+0000","last_unstale":"2024-09-17T09:11:59.135618+0000","last_undegraded":"2024-09-17T09:11:59.135618+0000","last_fullsized":"2024-09-17T09:11:59.135618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:19.746708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249513+0000","last_change":"2024-09-17T09:11:58.142433+0000","last_active":"2024-09-17T09:11:59.249513+0000","last_peered":"2024-09-17T09:11:59.249513+0000","last_clean":"2024-09-17T09:11:59.249513+0000","last_became_active":"2024-09-17T09:11:58.141948+0000","last_became_peered":"2024-09-17T09:11:58.141948+0000","last_unstale":"2024-09-17T09:11:59.249513+0000","last_undegraded":"2024-09-17T09:11:59.249513+0000","last_fullsized":"2024-09-17T09:11:59.249513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:54.032343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.449045+0000","last_change":"2024-09-17T09:11:54.117806+0000","last_active":"2024-09-17T09:11:59.449045+0000","last_peered":"2024-09-17T09:11:59.449045+0000","last_clean":"2024-09-17T09:11:59.449045+0000","last_became_active":"2024-09-17T09:11:54.117497+0000","last_became_peered":"2024-09-17T09:11:54.117497+0000","last_unstale":"2024-09-17T09:11:59.449045+0000","last_undegraded":"2024-09-17T09:11:59.449045+0000","last_fullsized":"2024-09-17T09:11:59.449045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:45:52.473697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135115+0000","last_change":"2024-09-17T09:11:52.108119+0000","last_active":"2024-09-17T09:11:59.135115+0000","last_peered":"2024-09-17T09:11:59.135115+0000","last_clean":"2024-09-17T09:11:59.135115+0000","last_became_active":"2024-09-17T09:11:52.107412+0000","last_became_peered":"2024-09-17T09:11:52.107412+0000","last_unstale":"2024-09-17T09:11:59.135115+0000","last_undegraded":"2024-09-17T09:11:59.135115+0000","last_fullsized":"2024-09-17T09:11:59.135115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:49.079925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249596+0000","last_change":"2024-09-17T09:11:56.127117+0000","last_active":"2024-09-17T09:11:59.249596+0000","last_peered":"2024-09-17T09:11:59.249596+0000","last_clean":"2024-09-17T09:11:59.249596+0000","last_became_active":"2024-09-17T09:11:56.126828+0000","last_became_peered":"2024-09-17T09:11:56.126828+0000","last_unstale":"2024-09-17T09:11:59.249596+0000","last_undegraded":"2024-09-17T09:11:59.249596+0000","last_fullsized":"2024-09-17T09:11:59.249596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:47.132842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249635+0000","last_change":"2024-09-17T09:11:58.142922+0000","last_active":"2024-09-17T09:11:59.249635+0000","last_peered":"2024-09-17T09:11:59.249635+0000","last_clean":"2024-09-17T09:11:59.249635+0000","last_became_active":"2024-09-17T09:11:58.142369+0000","last_became_peered":"2024-09-17T09:11:58.142369+0000","last_unstale":"2024-09-17T09:11:59.249635+0000","last_undegraded":"2024-09-17T09:11:59.249635+0000","last_fullsized":"2024-09-17T09:11:59.249635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:27.624464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"31'18","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.437898+0000","last_change":"2024-09-17T09:11:54.116050+0000","last_active":"2024-09-17T09:11:59.437898+0000","last_peered":"2024-09-17T09:11:59.437898+0000","last_clean":"2024-09-17T09:11:59.437898+0000","last_became_active":"2024-09-17T09:11:54.115714+0000","last_became_peered":"2024-09-17T09:11:54.115714+0000","last_unstale":"2024-09-17T09:11:59.437898+0000","last_undegraded":"2024-09-17T09:11:59.437898+0000","last_fullsized":"2024-09-17T09:11:59.437898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:56:12.193429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134390+0000","last_change":"2024-09-17T09:11:52.109321+0000","last_active":"2024-09-17T09:11:59.134390+0000","last_peered":"2024-09-17T09:11:59.134390+0000","last_clean":"2024-09-17T09:11:59.134390+0000","last_became_active":"2024-09-17T09:11:52.109005+0000","last_became_peered":"2024-09-17T09:11:52.109005+0000","last_unstale":"2024-09-17T09:11:59.134390+0000","last_undegraded":"2024-09-17T09:11:59.134390+0000","last_fullsized":"2024-09-17T09:11:59.134390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:01:37.612746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249812+0000","last_change":"2024-09-17T09:11:56.128545+0000","last_active":"2024-09-17T09:11:59.249812+0000","last_peered":"2024-09-17T09:11:59.249812+0000","last_clean":"2024-09-17T09:11:59.249812+0000","last_became_active":"2024-09-17T09:11:56.128170+0000","last_became_peered":"2024-09-17T09:11:56.128170+0000","last_unstale":"2024-09-17T09:11:59.249812+0000","last_undegraded":"2024-09-17T09:11:59.249812+0000","last_fullsized":"2024-09-17T09:11:59.249812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:56.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249740+0000","last_change":"2024-09-17T09:11:58.142388+0000","last_active":"2024-09-17T09:11:59.249740+0000","last_peered":"2024-09-17T09:11:59.249740+0000","last_clean":"2024-09-17T09:11:59.249740+0000","last_became_active":"2024-09-17T09:11:58.141986+0000","last_became_peered":"2024-09-17T09:11:58.141986+0000","last_unstale":"2024-09-17T09:11:59.249740+0000","last_undegraded":"2024-09-17T09:11:59.249740+0000","last_fullsized":"2024-09-17T09:11:59.249740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:57.301555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'14","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.468649+0000","last_change":"2024-09-17T09:11:54.117083+0000","last_active":"2024-09-17T09:11:59.468649+0000","last_peered":"2024-09-17T09:11:59.468649+0000","last_clean":"2024-09-17T09:11:59.468649+0000","last_became_active":"2024-09-17T09:11:54.116397+0000","last_became_peered":"2024-09-17T09:11:54.116397+0000","last_unstale":"2024-09-17T09:11:59.468649+0000","last_undegraded":"2024-09-17T09:11:59.468649+0000","last_fullsized":"2024-09-17T09:11:59.468649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:23:41.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135010+0000","last_change":"2024-09-17T09:11:52.109521+0000","last_active":"2024-09-17T09:11:59.135010+0000","last_peered":"2024-09-17T09:11:59.135010+0000","last_clean":"2024-09-17T09:11:59.135010+0000","last_became_active":"2024-09-17T09:11:52.109260+0000","last_became_peered":"2024-09-17T09:11:52.109260+0000","last_unstale":"2024-09-17T09:11:59.135010+0000","last_undegraded":"2024-09-17T09:11:59.135010+0000","last_fullsized":"2024-09-17T09:11:59.135010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:51.134965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136402+0000","last_change":"2024-09-17T09:11:56.125617+0000","last_active":"2024-09-17T09:11:59.136402+0000","last_peered":"2024-09-17T09:11:59.136402+0000","last_clean":"2024-09-17T09:11:59.136402+0000","last_became_active":"2024-09-17T09:11:56.125228+0000","last_became_peered":"2024-09-17T09:11:56.125228+0000","last_unstale":"2024-09-17T09:11:59.136402+0000","last_undegraded":"2024-09-17T09:11:59.136402+0000","last_fullsized":"2024-09-17T09:11:59.136402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:57:20.912266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136880+0000","last_change":"2024-09-17T09:11:58.143114+0000","last_active":"2024-09-17T09:11:59.136880+0000","last_peered":"2024-09-17T09:11:59.136880+0000","last_clean":"2024-09-17T09:11:59.136880+0000","last_became_active":"2024-09-17T09:11:58.142285+0000","last_became_peered":"2024-09-17T09:11:58.142285+0000","last_unstale":"2024-09-17T09:11:59.136880+0000","last_undegraded":"2024-09-17T09:11:59.136880+0000","last_fullsized":"2024-09-17T09:11:59.136880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:49.183728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.455583+0000","last_change":"2024-09-17T09:11:54.115414+0000","last_active":"2024-09-17T09:11:59.455583+0000","last_peered":"2024-09-17T09:11:59.455583+0000","last_clean":"2024-09-17T09:11:59.455583+0000","last_became_active":"2024-09-17T09:11:54.115083+0000","last_became_peered":"2024-09-17T09:11:54.115083+0000","last_unstale":"2024-09-17T09:11:59.455583+0000","last_undegraded":"2024-09-17T09:11:59.455583+0000","last_fullsized":"2024-09-17T09:11:59.455583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:32.358470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135665+0000","last_change":"2024-09-17T09:11:52.108341+0000","last_active":"2024-09-17T09:11:59.135665+0000","last_peered":"2024-09-17T09:11:59.135665+0000","last_clean":"2024-09-17T09:11:59.135665+0000","last_became_active":"2024-09-17T09:11:52.108051+0000","last_became_peered":"2024-09-17T09:11:52.108051+0000","last_unstale":"2024-09-17T09:11:59.135665+0000","last_undegraded":"2024-09-17T09:11:59.135665+0000","last_fullsized":"2024-09-17T09:11:59.135665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:09.070797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"32'208","reported_seq":302,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:22.494137+0000","last_change":"2024-09-17T09:11:39.657340+0000","last_active":"2024-09-17T09:12:22.494137+0000","last_peered":"2024-09-17T09:12:22.494137+0000","last_clean":"2024-09-17T09:12:22.494137+0000","last_became_active":"2024-09-17T09:11:39.657023+0000","last_became_peered":"2024-09-17T09:11:39.657023+0000","last_unstale":"2024-09-17T09:12:22.494137+0000","last_undegraded":"2024-09-17T09:12:22.494137+0000","last_fullsized":"2024-09-17T09:12:22.494137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:38.644290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:38.644290+0000","last_clean_scrub_stamp":"2024-09-17T09:11:38.644290+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:49.680832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":342,"num_write":267,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136784+0000","last_change":"2024-09-17T09:11:56.129619+0000","last_active":"2024-09-17T09:11:59.136784+0000","last_peered":"2024-09-17T09:11:59.136784+0000","last_clean":"2024-09-17T09:11:59.136784+0000","last_became_active":"2024-09-17T09:11:56.128883+0000","last_became_peered":"2024-09-17T09:11:56.128883+0000","last_unstale":"2024-09-17T09:11:59.136784+0000","last_undegraded":"2024-09-17T09:11:59.136784+0000","last_fullsized":"2024-09-17T09:11:59.136784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:21:08.642080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648309+0000","last_change":"2024-09-17T09:11:58.149029+0000","last_active":"2024-09-17T09:12:01.648309+0000","last_peered":"2024-09-17T09:12:01.648309+0000","last_clean":"2024-09-17T09:12:01.648309+0000","last_became_active":"2024-09-17T09:11:58.148229+0000","last_became_peered":"2024-09-17T09:11:58.148229+0000","last_unstale":"2024-09-17T09:12:01.648309+0000","last_undegraded":"2024-09-17T09:12:01.648309+0000","last_fullsized":"2024-09-17T09:12:01.648309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:23.011113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'17","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.461845+0000","last_change":"2024-09-17T09:11:54.118211+0000","last_active":"2024-09-17T09:11:59.461845+0000","last_peered":"2024-09-17T09:11:59.461845+0000","last_clean":"2024-09-17T09:11:59.461845+0000","last_became_active":"2024-09-17T09:11:54.117828+0000","last_became_peered":"2024-09-17T09:11:54.117828+0000","last_unstale":"2024-09-17T09:11:59.461845+0000","last_undegraded":"2024-09-17T09:11:59.461845+0000","last_fullsized":"2024-09-17T09:11:59.461845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:52:16.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135435+0000","last_change":"2024-09-17T09:11:52.111870+0000","last_active":"2024-09-17T09:11:59.135435+0000","last_peered":"2024-09-17T09:11:59.135435+0000","last_clean":"2024-09-17T09:11:59.135435+0000","last_became_active":"2024-09-17T09:11:52.111625+0000","last_became_peered":"2024-09-17T09:11:52.111625+0000","last_unstale":"2024-09-17T09:11:59.135435+0000","last_undegraded":"2024-09-17T09:11:59.135435+0000","last_fullsized":"2024-09-17T09:11:59.135435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:33:43.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135585+0000","last_change":"2024-09-17T09:11:56.129208+0000","last_active":"2024-09-17T09:11:59.135585+0000","last_peered":"2024-09-17T09:11:59.135585+0000","last_clean":"2024-09-17T09:11:59.135585+0000","last_became_active":"2024-09-17T09:11:56.128698+0000","last_became_peered":"2024-09-17T09:11:56.128698+0000","last_unstale":"2024-09-17T09:11:59.135585+0000","last_undegraded":"2024-09-17T09:11:59.135585+0000","last_fullsized":"2024-09-17T09:11:59.135585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:30.532352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648278+0000","last_change":"2024-09-17T09:11:58.148691+0000","last_active":"2024-09-17T09:12:01.648278+0000","last_peered":"2024-09-17T09:12:01.648278+0000","last_clean":"2024-09-17T09:12:01.648278+0000","last_became_active":"2024-09-17T09:11:58.148284+0000","last_became_peered":"2024-09-17T09:11:58.148284+0000","last_unstale":"2024-09-17T09:12:01.648278+0000","last_undegraded":"2024-09-17T09:12:01.648278+0000","last_fullsized":"2024-09-17T09:12:01.648278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:55:57.549638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.421841+0000","last_change":"2024-09-17T09:11:54.117845+0000","last_active":"2024-09-17T09:11:59.421841+0000","last_peered":"2024-09-17T09:11:59.421841+0000","last_clean":"2024-09-17T09:11:59.421841+0000","last_became_active":"2024-09-17T09:11:54.117444+0000","last_became_peered":"2024-09-17T09:11:54.117444+0000","last_unstale":"2024-09-17T09:11:59.421841+0000","last_undegraded":"2024-09-17T09:11:59.421841+0000","last_fullsized":"2024-09-17T09:11:59.421841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:40.681048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136169+0000","last_change":"2024-09-17T09:11:52.108166+0000","last_active":"2024-09-17T09:11:59.136169+0000","last_peered":"2024-09-17T09:11:59.136169+0000","last_clean":"2024-09-17T09:11:59.136169+0000","last_became_active":"2024-09-17T09:11:52.107896+0000","last_became_peered":"2024-09-17T09:11:52.107896+0000","last_unstale":"2024-09-17T09:11:59.136169+0000","last_undegraded":"2024-09-17T09:11:59.136169+0000","last_fullsized":"2024-09-17T09:11:59.136169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:59:20.037773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249480+0000","last_change":"2024-09-17T09:11:56.126406+0000","last_active":"2024-09-17T09:11:59.249480+0000","last_peered":"2024-09-17T09:11:59.249480+0000","last_clean":"2024-09-17T09:11:59.249480+0000","last_became_active":"2024-09-17T09:11:56.126095+0000","last_became_peered":"2024-09-17T09:11:56.126095+0000","last_unstale":"2024-09-17T09:11:59.249480+0000","last_undegraded":"2024-09-17T09:11:59.249480+0000","last_fullsized":"2024-09-17T09:11:59.249480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:33.759479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249400+0000","last_change":"2024-09-17T09:11:58.142801+0000","last_active":"2024-09-17T09:11:59.249400+0000","last_peered":"2024-09-17T09:11:59.249400+0000","last_clean":"2024-09-17T09:11:59.249400+0000","last_became_active":"2024-09-17T09:11:58.141974+0000","last_became_peered":"2024-09-17T09:11:58.141974+0000","last_unstale":"2024-09-17T09:11:59.249400+0000","last_undegraded":"2024-09-17T09:11:59.249400+0000","last_fullsized":"2024-09-17T09:11:59.249400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:45:22.651516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.485456+0000","last_change":"2024-09-17T09:11:54.119139+0000","last_active":"2024-09-17T09:11:59.485456+0000","last_peered":"2024-09-17T09:11:59.485456+0000","last_clean":"2024-09-17T09:11:59.485456+0000","last_became_active":"2024-09-17T09:11:54.118788+0000","last_became_peered":"2024-09-17T09:11:54.118788+0000","last_unstale":"2024-09-17T09:11:59.485456+0000","last_undegraded":"2024-09-17T09:11:59.485456+0000","last_fullsized":"2024-09-17T09:11:59.485456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:57:24.625528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136774+0000","last_change":"2024-09-17T09:11:52.109022+0000","last_active":"2024-09-17T09:11:59.136774+0000","last_peered":"2024-09-17T09:11:59.136774+0000","last_clean":"2024-09-17T09:11:59.136774+0000","last_became_active":"2024-09-17T09:11:52.108447+0000","last_became_peered":"2024-09-17T09:11:52.108447+0000","last_unstale":"2024-09-17T09:11:59.136774+0000","last_undegraded":"2024-09-17T09:11:59.136774+0000","last_fullsized":"2024-09-17T09:11:59.136774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:55.022854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136482+0000","last_change":"2024-09-17T09:11:56.126521+0000","last_active":"2024-09-17T09:11:59.136482+0000","last_peered":"2024-09-17T09:11:59.136482+0000","last_clean":"2024-09-17T09:11:59.136482+0000","last_became_active":"2024-09-17T09:11:56.126284+0000","last_became_peered":"2024-09-17T09:11:56.126284+0000","last_unstale":"2024-09-17T09:11:59.136482+0000","last_undegraded":"2024-09-17T09:11:59.136482+0000","last_fullsized":"2024-09-17T09:11:59.136482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:18.361988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134912+0000","last_change":"2024-09-17T09:11:58.142837+0000","last_active":"2024-09-17T09:11:59.134912+0000","last_peered":"2024-09-17T09:11:59.134912+0000","last_clean":"2024-09-17T09:11:59.134912+0000","last_became_active":"2024-09-17T09:11:58.142086+0000","last_became_peered":"2024-09-17T09:11:58.142086+0000","last_unstale":"2024-09-17T09:11:59.134912+0000","last_undegraded":"2024-09-17T09:11:59.134912+0000","last_fullsized":"2024-09-17T09:11:59.134912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:10.067505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.463859+0000","last_change":"2024-09-17T09:11:54.120112+0000","last_active":"2024-09-17T09:11:59.463859+0000","last_peered":"2024-09-17T09:11:59.463859+0000","last_clean":"2024-09-17T09:11:59.463859+0000","last_became_active":"2024-09-17T09:11:54.119865+0000","last_became_peered":"2024-09-17T09:11:54.119865+0000","last_unstale":"2024-09-17T09:11:59.463859+0000","last_undegraded":"2024-09-17T09:11:59.463859+0000","last_fullsized":"2024-09-17T09:11:59.463859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:01.165597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.258556+0000","last_change":"2024-09-17T09:11:52.108141+0000","last_active":"2024-09-17T09:11:59.258556+0000","last_peered":"2024-09-17T09:11:59.258556+0000","last_clean":"2024-09-17T09:11:59.258556+0000","last_became_active":"2024-09-17T09:11:52.107629+0000","last_became_peered":"2024-09-17T09:11:52.107629+0000","last_unstale":"2024-09-17T09:11:59.258556+0000","last_undegraded":"2024-09-17T09:11:59.258556+0000","last_fullsized":"2024-09-17T09:11:59.258556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:58:47.540645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036618+0000","last_change":"2024-09-17T09:11:56.126399+0000","last_active":"2024-09-17T09:12:35.036618+0000","last_peered":"2024-09-17T09:12:35.036618+0000","last_clean":"2024-09-17T09:12:35.036618+0000","last_became_active":"2024-09-17T09:11:56.126058+0000","last_became_peered":"2024-09-17T09:11:56.126058+0000","last_unstale":"2024-09-17T09:12:35.036618+0000","last_undegraded":"2024-09-17T09:12:35.036618+0000","last_fullsized":"2024-09-17T09:12:35.036618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:07.392282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648096+0000","last_change":"2024-09-17T09:11:58.148785+0000","last_active":"2024-09-17T09:12:01.648096+0000","last_peered":"2024-09-17T09:12:01.648096+0000","last_clean":"2024-09-17T09:12:01.648096+0000","last_became_active":"2024-09-17T09:11:58.148169+0000","last_became_peered":"2024-09-17T09:11:58.148169+0000","last_unstale":"2024-09-17T09:12:01.648096+0000","last_undegraded":"2024-09-17T09:12:01.648096+0000","last_fullsized":"2024-09-17T09:12:01.648096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:24.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.470611+0000","last_change":"2024-09-17T09:11:54.119838+0000","last_active":"2024-09-17T09:11:59.470611+0000","last_peered":"2024-09-17T09:11:59.470611+0000","last_clean":"2024-09-17T09:11:59.470611+0000","last_became_active":"2024-09-17T09:11:54.119178+0000","last_became_peered":"2024-09-17T09:11:54.119178+0000","last_unstale":"2024-09-17T09:11:59.470611+0000","last_undegraded":"2024-09-17T09:11:59.470611+0000","last_fullsized":"2024-09-17T09:11:59.470611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:09.214283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135105+0000","last_change":"2024-09-17T09:11:52.108043+0000","last_active":"2024-09-17T09:11:59.135105+0000","last_peered":"2024-09-17T09:11:59.135105+0000","last_clean":"2024-09-17T09:11:59.135105+0000","last_became_active":"2024-09-17T09:11:52.107742+0000","last_became_peered":"2024-09-17T09:11:52.107742+0000","last_unstale":"2024-09-17T09:11:59.135105+0000","last_undegraded":"2024-09-17T09:11:59.135105+0000","last_fullsized":"2024-09-17T09:11:59.135105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:23.515666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249715+0000","last_change":"2024-09-17T09:11:56.128847+0000","last_active":"2024-09-17T09:11:59.249715+0000","last_peered":"2024-09-17T09:11:59.249715+0000","last_clean":"2024-09-17T09:11:59.249715+0000","last_became_active":"2024-09-17T09:11:56.128516+0000","last_became_peered":"2024-09-17T09:11:56.128516+0000","last_unstale":"2024-09-17T09:11:59.249715+0000","last_undegraded":"2024-09-17T09:11:59.249715+0000","last_fullsized":"2024-09-17T09:11:59.249715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:46.253270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249776+0000","last_change":"2024-09-17T09:11:58.143662+0000","last_active":"2024-09-17T09:11:59.249776+0000","last_peered":"2024-09-17T09:11:59.249776+0000","last_clean":"2024-09-17T09:11:59.249776+0000","last_became_active":"2024-09-17T09:11:58.143296+0000","last_became_peered":"2024-09-17T09:11:58.143296+0000","last_unstale":"2024-09-17T09:11:59.249776+0000","last_undegraded":"2024-09-17T09:11:59.249776+0000","last_fullsized":"2024-09-17T09:11:59.249776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:31:33.820585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.298859+0000","last_change":"2024-09-17T09:11:54.118130+0000","last_active":"2024-09-17T09:11:59.298859+0000","last_peered":"2024-09-17T09:11:59.298859+0000","last_clean":"2024-09-17T09:11:59.298859+0000","last_became_active":"2024-09-17T09:11:54.117100+0000","last_became_peered":"2024-09-17T09:11:54.117100+0000","last_unstale":"2024-09-17T09:11:59.298859+0000","last_undegraded":"2024-09-17T09:11:59.298859+0000","last_fullsized":"2024-09-17T09:11:59.298859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:49:00.385969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134913+0000","last_change":"2024-09-17T09:11:52.107660+0000","last_active":"2024-09-17T09:11:59.134913+0000","last_peered":"2024-09-17T09:11:59.134913+0000","last_clean":"2024-09-17T09:11:59.134913+0000","last_became_active":"2024-09-17T09:11:52.106779+0000","last_became_peered":"2024-09-17T09:11:52.106779+0000","last_unstale":"2024-09-17T09:11:59.134913+0000","last_undegraded":"2024-09-17T09:11:59.134913+0000","last_fullsized":"2024-09-17T09:11:59.134913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:36.247919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249891+0000","last_change":"2024-09-17T09:11:56.128353+0000","last_active":"2024-09-17T09:11:59.249891+0000","last_peered":"2024-09-17T09:11:59.249891+0000","last_clean":"2024-09-17T09:11:59.249891+0000","last_became_active":"2024-09-17T09:11:56.128065+0000","last_became_peered":"2024-09-17T09:11:56.128065+0000","last_unstale":"2024-09-17T09:11:59.249891+0000","last_undegraded":"2024-09-17T09:11:59.249891+0000","last_fullsized":"2024-09-17T09:11:59.249891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:31.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.137156+0000","last_change":"2024-09-17T09:11:58.142879+0000","last_active":"2024-09-17T09:11:59.137156+0000","last_peered":"2024-09-17T09:11:59.137156+0000","last_clean":"2024-09-17T09:11:59.137156+0000","last_became_active":"2024-09-17T09:11:58.142481+0000","last_became_peered":"2024-09-17T09:11:58.142481+0000","last_unstale":"2024-09-17T09:11:59.137156+0000","last_undegraded":"2024-09-17T09:11:59.137156+0000","last_fullsized":"2024-09-17T09:11:59.137156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:14.095658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.442169+0000","last_change":"2024-09-17T09:11:54.117271+0000","last_active":"2024-09-17T09:11:59.442169+0000","last_peered":"2024-09-17T09:11:59.442169+0000","last_clean":"2024-09-17T09:11:59.442169+0000","last_became_active":"2024-09-17T09:11:54.116778+0000","last_became_peered":"2024-09-17T09:11:54.116778+0000","last_unstale":"2024-09-17T09:11:59.442169+0000","last_undegraded":"2024-09-17T09:11:59.442169+0000","last_fullsized":"2024-09-17T09:11:59.442169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:28.810074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135261+0000","last_change":"2024-09-17T09:11:52.111701+0000","last_active":"2024-09-17T09:11:59.135261+0000","last_peered":"2024-09-17T09:11:59.135261+0000","last_clean":"2024-09-17T09:11:59.135261+0000","last_became_active":"2024-09-17T09:11:52.111417+0000","last_became_peered":"2024-09-17T09:11:52.111417+0000","last_unstale":"2024-09-17T09:11:59.135261+0000","last_undegraded":"2024-09-17T09:11:59.135261+0000","last_fullsized":"2024-09-17T09:11:59.135261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:08:36.145798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036579+0000","last_change":"2024-09-17T09:11:56.125582+0000","last_active":"2024-09-17T09:12:35.036579+0000","last_peered":"2024-09-17T09:12:35.036579+0000","last_clean":"2024-09-17T09:12:35.036579+0000","last_became_active":"2024-09-17T09:11:56.125274+0000","last_became_peered":"2024-09-17T09:11:56.125274+0000","last_unstale":"2024-09-17T09:12:35.036579+0000","last_undegraded":"2024-09-17T09:12:35.036579+0000","last_fullsized":"2024-09-17T09:12:35.036579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:45:31.159989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.137234+0000","last_change":"2024-09-17T09:11:58.143489+0000","last_active":"2024-09-17T09:11:59.137234+0000","last_peered":"2024-09-17T09:11:59.137234+0000","last_clean":"2024-09-17T09:11:59.137234+0000","last_became_active":"2024-09-17T09:11:58.142183+0000","last_became_peered":"2024-09-17T09:11:58.142183+0000","last_unstale":"2024-09-17T09:11:59.137234+0000","last_undegraded":"2024-09-17T09:11:59.137234+0000","last_fullsized":"2024-09-17T09:11:59.137234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:34.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.376078+0000","last_change":"2024-09-17T09:11:54.116486+0000","last_active":"2024-09-17T09:11:59.376078+0000","last_peered":"2024-09-17T09:11:59.376078+0000","last_clean":"2024-09-17T09:11:59.376078+0000","last_became_active":"2024-09-17T09:11:54.116177+0000","last_became_peered":"2024-09-17T09:11:54.116177+0000","last_unstale":"2024-09-17T09:11:59.376078+0000","last_undegraded":"2024-09-17T09:11:59.376078+0000","last_fullsized":"2024-09-17T09:11:59.376078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:05.593001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135355+0000","last_change":"2024-09-17T09:11:52.108255+0000","last_active":"2024-09-17T09:11:59.135355+0000","last_peered":"2024-09-17T09:11:59.135355+0000","last_clean":"2024-09-17T09:11:59.135355+0000","last_became_active":"2024-09-17T09:11:52.107915+0000","last_became_peered":"2024-09-17T09:11:52.107915+0000","last_unstale":"2024-09-17T09:11:59.135355+0000","last_undegraded":"2024-09-17T09:11:59.135355+0000","last_fullsized":"2024-09-17T09:11:59.135355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:21:39.311632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036557+0000","last_change":"2024-09-17T09:11:56.124810+0000","last_active":"2024-09-17T09:12:35.036557+0000","last_peered":"2024-09-17T09:12:35.036557+0000","last_clean":"2024-09-17T09:12:35.036557+0000","last_became_active":"2024-09-17T09:11:56.124531+0000","last_became_peered":"2024-09-17T09:11:56.124531+0000","last_unstale":"2024-09-17T09:12:35.036557+0000","last_undegraded":"2024-09-17T09:12:35.036557+0000","last_fullsized":"2024-09-17T09:12:35.036557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:54.271581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249533+0000","last_change":"2024-09-17T09:11:58.144727+0000","last_active":"2024-09-17T09:11:59.249533+0000","last_peered":"2024-09-17T09:11:59.249533+0000","last_clean":"2024-09-17T09:11:59.249533+0000","last_became_active":"2024-09-17T09:11:58.143822+0000","last_became_peered":"2024-09-17T09:11:58.143822+0000","last_unstale":"2024-09-17T09:11:59.249533+0000","last_undegraded":"2024-09-17T09:11:59.249533+0000","last_fullsized":"2024-09-17T09:11:59.249533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:59:36.926154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.452826+0000","last_change":"2024-09-17T09:11:54.120092+0000","last_active":"2024-09-17T09:11:59.452826+0000","last_peered":"2024-09-17T09:11:59.452826+0000","last_clean":"2024-09-17T09:11:59.452826+0000","last_became_active":"2024-09-17T09:11:54.119553+0000","last_became_peered":"2024-09-17T09:11:54.119553+0000","last_unstale":"2024-09-17T09:11:59.452826+0000","last_undegraded":"2024-09-17T09:11:59.452826+0000","last_fullsized":"2024-09-17T09:11:59.452826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:03.392330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135658+0000","last_change":"2024-09-17T09:11:52.108316+0000","last_active":"2024-09-17T09:11:59.135658+0000","last_peered":"2024-09-17T09:11:59.135658+0000","last_clean":"2024-09-17T09:11:59.135658+0000","last_became_active":"2024-09-17T09:11:52.107986+0000","last_became_peered":"2024-09-17T09:11:52.107986+0000","last_unstale":"2024-09-17T09:11:59.135658+0000","last_undegraded":"2024-09-17T09:11:59.135658+0000","last_fullsized":"2024-09-17T09:11:59.135658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:53.774019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249445+0000","last_change":"2024-09-17T09:11:56.126392+0000","last_active":"2024-09-17T09:11:59.249445+0000","last_peered":"2024-09-17T09:11:59.249445+0000","last_clean":"2024-09-17T09:11:59.249445+0000","last_became_active":"2024-09-17T09:11:56.126061+0000","last_became_peered":"2024-09-17T09:11:56.126061+0000","last_unstale":"2024-09-17T09:11:59.249445+0000","last_undegraded":"2024-09-17T09:11:59.249445+0000","last_fullsized":"2024-09-17T09:11:59.249445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:09.085211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648238+0000","last_change":"2024-09-17T09:11:58.149032+0000","last_active":"2024-09-17T09:12:01.648238+0000","last_peered":"2024-09-17T09:12:01.648238+0000","last_clean":"2024-09-17T09:12:01.648238+0000","last_became_active":"2024-09-17T09:11:58.148157+0000","last_became_peered":"2024-09-17T09:11:58.148157+0000","last_unstale":"2024-09-17T09:12:01.648238+0000","last_undegraded":"2024-09-17T09:12:01.648238+0000","last_fullsized":"2024-09-17T09:12:01.648238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:16.315701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.451087+0000","last_change":"2024-09-17T09:11:54.117676+0000","last_active":"2024-09-17T09:11:59.451087+0000","last_peered":"2024-09-17T09:11:59.451087+0000","last_clean":"2024-09-17T09:11:59.451087+0000","last_became_active":"2024-09-17T09:11:54.117326+0000","last_became_peered":"2024-09-17T09:11:54.117326+0000","last_unstale":"2024-09-17T09:11:59.451087+0000","last_undegraded":"2024-09-17T09:11:59.451087+0000","last_fullsized":"2024-09-17T09:11:59.451087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:26:44.258801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136152+0000","last_change":"2024-09-17T09:11:52.107962+0000","last_active":"2024-09-17T09:11:59.136152+0000","last_peered":"2024-09-17T09:11:59.136152+0000","last_clean":"2024-09-17T09:11:59.136152+0000","last_became_active":"2024-09-17T09:11:52.107689+0000","last_became_peered":"2024-09-17T09:11:52.107689+0000","last_unstale":"2024-09-17T09:11:59.136152+0000","last_undegraded":"2024-09-17T09:11:59.136152+0000","last_fullsized":"2024-09-17T09:11:59.136152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:01.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136584+0000","last_change":"2024-09-17T09:11:56.127377+0000","last_active":"2024-09-17T09:11:59.136584+0000","last_peered":"2024-09-17T09:11:59.136584+0000","last_clean":"2024-09-17T09:11:59.136584+0000","last_became_active":"2024-09-17T09:11:56.126146+0000","last_became_peered":"2024-09-17T09:11:56.126146+0000","last_unstale":"2024-09-17T09:11:59.136584+0000","last_undegraded":"2024-09-17T09:11:59.136584+0000","last_fullsized":"2024-09-17T09:11:59.136584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:13.833773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648228+0000","last_change":"2024-09-17T09:11:58.148873+0000","last_active":"2024-09-17T09:12:01.648228+0000","last_peered":"2024-09-17T09:12:01.648228+0000","last_clean":"2024-09-17T09:12:01.648228+0000","last_became_active":"2024-09-17T09:11:58.148457+0000","last_became_peered":"2024-09-17T09:11:58.148457+0000","last_unstale":"2024-09-17T09:12:01.648228+0000","last_undegraded":"2024-09-17T09:12:01.648228+0000","last_fullsized":"2024-09-17T09:12:01.648228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:11:19.392318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.434020+0000","last_change":"2024-09-17T09:11:54.115466+0000","last_active":"2024-09-17T09:11:59.434020+0000","last_peered":"2024-09-17T09:11:59.434020+0000","last_clean":"2024-09-17T09:11:59.434020+0000","last_became_active":"2024-09-17T09:11:54.115161+0000","last_became_peered":"2024-09-17T09:11:54.115161+0000","last_unstale":"2024-09-17T09:11:59.434020+0000","last_undegraded":"2024-09-17T09:11:59.434020+0000","last_fullsized":"2024-09-17T09:11:59.434020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:07:54.826694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136404+0000","last_change":"2024-09-17T09:11:52.107017+0000","last_active":"2024-09-17T09:11:59.136404+0000","last_peered":"2024-09-17T09:11:59.136404+0000","last_clean":"2024-09-17T09:11:59.136404+0000","last_became_active":"2024-09-17T09:11:52.106591+0000","last_became_peered":"2024-09-17T09:11:52.106591+0000","last_unstale":"2024-09-17T09:11:59.136404+0000","last_undegraded":"2024-09-17T09:11:59.136404+0000","last_fullsized":"2024-09-17T09:11:59.136404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:45.283634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249286+0000","last_change":"2024-09-17T09:11:56.128329+0000","last_active":"2024-09-17T09:11:59.249286+0000","last_peered":"2024-09-17T09:11:59.249286+0000","last_clean":"2024-09-17T09:11:59.249286+0000","last_became_active":"2024-09-17T09:11:56.127586+0000","last_became_peered":"2024-09-17T09:11:56.127586+0000","last_unstale":"2024-09-17T09:11:59.249286+0000","last_undegraded":"2024-09-17T09:11:59.249286+0000","last_fullsized":"2024-09-17T09:11:59.249286+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:29.758474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134828+0000","last_change":"2024-09-17T09:11:58.143009+0000","last_active":"2024-09-17T09:11:59.134828+0000","last_peered":"2024-09-17T09:11:59.134828+0000","last_clean":"2024-09-17T09:11:59.134828+0000","last_became_active":"2024-09-17T09:11:58.142531+0000","last_became_peered":"2024-09-17T09:11:58.142531+0000","last_unstale":"2024-09-17T09:11:59.134828+0000","last_undegraded":"2024-09-17T09:11:59.134828+0000","last_fullsized":"2024-09-17T09:11:59.134828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:32.922780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.311636+0000","last_change":"2024-09-17T09:11:54.117650+0000","last_active":"2024-09-17T09:11:59.311636+0000","last_peered":"2024-09-17T09:11:59.311636+0000","last_clean":"2024-09-17T09:11:59.311636+0000","last_became_active":"2024-09-17T09:11:54.117303+0000","last_became_peered":"2024-09-17T09:11:54.117303+0000","last_unstale":"2024-09-17T09:11:59.311636+0000","last_undegraded":"2024-09-17T09:11:59.311636+0000","last_fullsized":"2024-09-17T09:11:59.311636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:53.740029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136515+0000","last_change":"2024-09-17T09:11:52.109205+0000","last_active":"2024-09-17T09:11:59.136515+0000","last_peered":"2024-09-17T09:11:59.136515+0000","last_clean":"2024-09-17T09:11:59.136515+0000","last_became_active":"2024-09-17T09:11:52.108337+0000","last_became_peered":"2024-09-17T09:11:52.108337+0000","last_unstale":"2024-09-17T09:11:59.136515+0000","last_undegraded":"2024-09-17T09:11:59.136515+0000","last_fullsized":"2024-09-17T09:11:59.136515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:39.302666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249380+0000","last_change":"2024-09-17T09:11:56.127088+0000","last_active":"2024-09-17T09:11:59.249380+0000","last_peered":"2024-09-17T09:11:59.249380+0000","last_clean":"2024-09-17T09:11:59.249380+0000","last_became_active":"2024-09-17T09:11:56.126760+0000","last_became_peered":"2024-09-17T09:11:56.126760+0000","last_unstale":"2024-09-17T09:11:59.249380+0000","last_undegraded":"2024-09-17T09:11:59.249380+0000","last_fullsized":"2024-09-17T09:11:59.249380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:12.851678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134799+0000","last_change":"2024-09-17T09:11:58.145003+0000","last_active":"2024-09-17T09:11:59.134799+0000","last_peered":"2024-09-17T09:11:59.134799+0000","last_clean":"2024-09-17T09:11:59.134799+0000","last_became_active":"2024-09-17T09:11:58.144637+0000","last_became_peered":"2024-09-17T09:11:58.144637+0000","last_unstale":"2024-09-17T09:11:59.134799+0000","last_undegraded":"2024-09-17T09:11:59.134799+0000","last_fullsized":"2024-09-17T09:11:59.134799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:11:53.006286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136082+0000","last_change":"2024-09-17T09:11:58.143366+0000","last_active":"2024-09-17T09:11:59.136082+0000","last_peered":"2024-09-17T09:11:59.136082+0000","last_clean":"2024-09-17T09:11:59.136082+0000","last_became_active":"2024-09-17T09:11:58.142954+0000","last_became_peered":"2024-09-17T09:11:58.142954+0000","last_unstale":"2024-09-17T09:11:59.136082+0000","last_undegraded":"2024-09-17T09:11:59.136082+0000","last_fullsized":"2024-09-17T09:11:59.136082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:57.891313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.477146+0000","last_change":"2024-09-17T09:11:54.116798+0000","last_active":"2024-09-17T09:11:59.477146+0000","last_peered":"2024-09-17T09:11:59.477146+0000","last_clean":"2024-09-17T09:11:59.477146+0000","last_became_active":"2024-09-17T09:11:54.115289+0000","last_became_peered":"2024-09-17T09:11:54.115289+0000","last_unstale":"2024-09-17T09:11:59.477146+0000","last_undegraded":"2024-09-17T09:11:59.477146+0000","last_fullsized":"2024-09-17T09:11:59.477146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:36:02.718609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135146+0000","last_change":"2024-09-17T09:11:52.108876+0000","last_active":"2024-09-17T09:11:59.135146+0000","last_peered":"2024-09-17T09:11:59.135146+0000","last_clean":"2024-09-17T09:11:59.135146+0000","last_became_active":"2024-09-17T09:11:52.108159+0000","last_became_peered":"2024-09-17T09:11:52.108159+0000","last_unstale":"2024-09-17T09:11:59.135146+0000","last_undegraded":"2024-09-17T09:11:59.135146+0000","last_fullsized":"2024-09-17T09:11:59.135146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:43:48.868581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249757+0000","last_change":"2024-09-17T09:11:56.127036+0000","last_active":"2024-09-17T09:11:59.249757+0000","last_peered":"2024-09-17T09:11:59.249757+0000","last_clean":"2024-09-17T09:11:59.249757+0000","last_became_active":"2024-09-17T09:11:56.126753+0000","last_became_peered":"2024-09-17T09:11:56.126753+0000","last_unstale":"2024-09-17T09:11:59.249757+0000","last_undegraded":"2024-09-17T09:11:59.249757+0000","last_fullsized":"2024-09-17T09:11:59.249757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:28.700556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249661+0000","last_change":"2024-09-17T09:11:58.142525+0000","last_active":"2024-09-17T09:11:59.249661+0000","last_peered":"2024-09-17T09:11:59.249661+0000","last_clean":"2024-09-17T09:11:59.249661+0000","last_became_active":"2024-09-17T09:11:58.142119+0000","last_became_peered":"2024-09-17T09:11:58.142119+0000","last_unstale":"2024-09-17T09:11:59.249661+0000","last_undegraded":"2024-09-17T09:11:59.249661+0000","last_fullsized":"2024-09-17T09:11:59.249661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:58.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.283175+0000","last_change":"2024-09-17T09:11:54.116984+0000","last_active":"2024-09-17T09:11:59.283175+0000","last_peered":"2024-09-17T09:11:59.283175+0000","last_clean":"2024-09-17T09:11:59.283175+0000","last_became_active":"2024-09-17T09:11:54.116529+0000","last_became_peered":"2024-09-17T09:11:54.116529+0000","last_unstale":"2024-09-17T09:11:59.283175+0000","last_undegraded":"2024-09-17T09:11:59.283175+0000","last_fullsized":"2024-09-17T09:11:59.283175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:17.365472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134618+0000","last_change":"2024-09-17T09:11:52.108771+0000","last_active":"2024-09-17T09:11:59.134618+0000","last_peered":"2024-09-17T09:11:59.134618+0000","last_clean":"2024-09-17T09:11:59.134618+0000","last_became_active":"2024-09-17T09:11:52.107523+0000","last_became_peered":"2024-09-17T09:11:52.107523+0000","last_unstale":"2024-09-17T09:11:59.134618+0000","last_undegraded":"2024-09-17T09:11:59.134618+0000","last_fullsized":"2024-09-17T09:11:59.134618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:03:45.054200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:35.036600+0000","last_change":"2024-09-17T09:11:56.127178+0000","last_active":"2024-09-17T09:12:35.036600+0000","last_peered":"2024-09-17T09:12:35.036600+0000","last_clean":"2024-09-17T09:12:35.036600+0000","last_became_active":"2024-09-17T09:11:56.126410+0000","last_became_peered":"2024-09-17T09:11:56.126410+0000","last_unstale":"2024-09-17T09:12:35.036600+0000","last_undegraded":"2024-09-17T09:12:35.036600+0000","last_fullsized":"2024-09-17T09:12:35.036600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.874497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135200+0000","last_change":"2024-09-17T09:11:52.108343+0000","last_active":"2024-09-17T09:11:59.135200+0000","last_peered":"2024-09-17T09:11:59.135200+0000","last_clean":"2024-09-17T09:11:59.135200+0000","last_became_active":"2024-09-17T09:11:52.108058+0000","last_became_peered":"2024-09-17T09:11:52.108058+0000","last_unstale":"2024-09-17T09:11:59.135200+0000","last_undegraded":"2024-09-17T09:11:59.135200+0000","last_fullsized":"2024-09-17T09:11:59.135200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:04:26.165359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.361327+0000","last_change":"2024-09-17T09:11:54.120073+0000","last_active":"2024-09-17T09:11:59.361327+0000","last_peered":"2024-09-17T09:11:59.361327+0000","last_clean":"2024-09-17T09:11:59.361327+0000","last_became_active":"2024-09-17T09:11:54.119787+0000","last_became_peered":"2024-09-17T09:11:54.119787+0000","last_unstale":"2024-09-17T09:11:59.361327+0000","last_undegraded":"2024-09-17T09:11:59.361327+0000","last_fullsized":"2024-09-17T09:11:59.361327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:05.897190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135857+0000","last_change":"2024-09-17T09:11:56.125748+0000","last_active":"2024-09-17T09:11:59.135857+0000","last_peered":"2024-09-17T09:11:59.135857+0000","last_clean":"2024-09-17T09:11:59.135857+0000","last_became_active":"2024-09-17T09:11:56.125494+0000","last_became_peered":"2024-09-17T09:11:56.125494+0000","last_unstale":"2024-09-17T09:11:59.135857+0000","last_undegraded":"2024-09-17T09:11:59.135857+0000","last_fullsized":"2024-09-17T09:11:59.135857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:28.641507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249617+0000","last_change":"2024-09-17T09:11:58.143012+0000","last_active":"2024-09-17T09:11:59.249617+0000","last_peered":"2024-09-17T09:11:59.249617+0000","last_clean":"2024-09-17T09:11:59.249617+0000","last_became_active":"2024-09-17T09:11:58.142755+0000","last_became_peered":"2024-09-17T09:11:58.142755+0000","last_unstale":"2024-09-17T09:11:59.249617+0000","last_undegraded":"2024-09-17T09:11:59.249617+0000","last_fullsized":"2024-09-17T09:11:59.249617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:48:45.367728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135575+0000","last_change":"2024-09-17T09:11:52.107923+0000","last_active":"2024-09-17T09:11:59.135575+0000","last_peered":"2024-09-17T09:11:59.135575+0000","last_clean":"2024-09-17T09:11:59.135575+0000","last_became_active":"2024-09-17T09:11:52.107554+0000","last_became_peered":"2024-09-17T09:11:52.107554+0000","last_unstale":"2024-09-17T09:11:59.135575+0000","last_undegraded":"2024-09-17T09:11:59.135575+0000","last_fullsized":"2024-09-17T09:11:59.135575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:12.378703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.382039+0000","last_change":"2024-09-17T09:11:54.119391+0000","last_active":"2024-09-17T09:11:59.382039+0000","last_peered":"2024-09-17T09:11:59.382039+0000","last_clean":"2024-09-17T09:11:59.382039+0000","last_became_active":"2024-09-17T09:11:54.119108+0000","last_became_peered":"2024-09-17T09:11:54.119108+0000","last_unstale":"2024-09-17T09:11:59.382039+0000","last_undegraded":"2024-09-17T09:11:59.382039+0000","last_fullsized":"2024-09-17T09:11:59.382039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:44.613781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136727+0000","last_change":"2024-09-17T09:11:56.125765+0000","last_active":"2024-09-17T09:11:59.136727+0000","last_peered":"2024-09-17T09:11:59.136727+0000","last_clean":"2024-09-17T09:11:59.136727+0000","last_became_active":"2024-09-17T09:11:56.125482+0000","last_became_peered":"2024-09-17T09:11:56.125482+0000","last_unstale":"2024-09-17T09:11:59.136727+0000","last_undegraded":"2024-09-17T09:11:59.136727+0000","last_fullsized":"2024-09-17T09:11:59.136727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:53.975700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.282130+0000","last_change":"2024-09-17T09:11:58.142723+0000","last_active":"2024-09-17T09:11:59.282130+0000","last_peered":"2024-09-17T09:11:59.282130+0000","last_clean":"2024-09-17T09:11:59.282130+0000","last_became_active":"2024-09-17T09:11:58.142395+0000","last_became_peered":"2024-09-17T09:11:58.142395+0000","last_unstale":"2024-09-17T09:11:59.282130+0000","last_undegraded":"2024-09-17T09:11:59.282130+0000","last_fullsized":"2024-09-17T09:11:59.282130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.773716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":96,"acting":96,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1386,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":342,"num_write":267,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411342,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":32144,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93708912,"statfs":{"total":95990841344,"available":95957925888,"internally_reserved":0,"allocated":1052672,"data_stored":703028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":32144,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93708912,"statfs":{"total":95990841344,"available":95957925888,"internally_reserved":0,"allocated":1052672,"data_stored":703028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 09:12:15 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.502},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.51400000000000001}]},{"osd":2,"last update":"Tue Sep 17 09:12:39 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.54300000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":36240,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93704816,"statfs":{"total":95990841344,"available":95953731584,"internally_reserved":0,"allocated":1052672,"data_stored":703028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 09:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.44},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46500000000000002}]},{"osd":2,"last update":"Tue Sep 17 09:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":3702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":3702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":3702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T09:12:46.314 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-17T09:12:46.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:46 smithi161 ceph-mon[27677]: pgmap v15: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:46.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:46 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:46.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:46 smithi179 ceph-mon[27782]: pgmap v15: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:46.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:46 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:47.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:47 smithi042 ceph-mon[25899]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:12:47.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:47 smithi161 ceph-mon[27677]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:12:47.528 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:47 smithi179 ceph-mon[27782]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:12:48.224 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:48 smithi042 ceph-mon[25899]: pgmap v16: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:48.420 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:48 smithi179 ceph-mon[27782]: pgmap v16: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:48.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:48 smithi161 ceph-mon[27677]: pgmap v16: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:48.699 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:50.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:50 smithi042 ceph-mon[25899]: pgmap v17: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:50.488 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:50 smithi179 ceph-mon[27782]: pgmap v17: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:50.491 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:50 smithi161 ceph-mon[27677]: pgmap v17: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:51.096 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:12:51.098 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-09-17T09:12:51.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:51 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:51.357 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:51 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:51.520 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:51 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:12:51.703 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-17T09:12:50.433997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595838,"num_objects":193,"num_object_clones":0,"num_object_copies":579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":193,"num_whiteouts":0,"num_read":962,"num_read_kb":809,"num_write":691,"num_write_kb":4544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":387,"acting":387,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":387,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":281223168,"kb_used":100528,"kb_used_data":3084,"kb_used_omap":4,"kb_used_meta":97403,"kb_avail":281122640,"statfs":{"total":287972524032,"available":287869583360,"internally_reserved":0,"allocated":3158016,"data_stored":2109084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":99741010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002679"},"pg_stats":[{"pgid":"2.1f","version":"24'1","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.248469+0000","last_change":"2024-09-17T09:11:52.108332+0000","last_active":"2024-09-17T09:11:59.248469+0000","last_peered":"2024-09-17T09:11:59.248469+0000","last_clean":"2024-09-17T09:11:59.248469+0000","last_became_active":"2024-09-17T09:11:52.107676+0000","last_became_peered":"2024-09-17T09:11:52.107676+0000","last_unstale":"2024-09-17T09:11:59.248469+0000","last_undegraded":"2024-09-17T09:11:59.248469+0000","last_fullsized":"2024-09-17T09:11:59.248469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:19.073428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.466540+0000","last_change":"2024-09-17T09:11:54.116966+0000","last_active":"2024-09-17T09:11:59.466540+0000","last_peered":"2024-09-17T09:11:59.466540+0000","last_clean":"2024-09-17T09:11:59.466540+0000","last_became_active":"2024-09-17T09:11:54.116385+0000","last_became_peered":"2024-09-17T09:11:54.116385+0000","last_unstale":"2024-09-17T09:11:59.466540+0000","last_undegraded":"2024-09-17T09:11:59.466540+0000","last_fullsized":"2024-09-17T09:11:59.466540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:26.105442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135262+0000","last_change":"2024-09-17T09:11:56.125610+0000","last_active":"2024-09-17T09:11:59.135262+0000","last_peered":"2024-09-17T09:11:59.135262+0000","last_clean":"2024-09-17T09:11:59.135262+0000","last_became_active":"2024-09-17T09:11:56.125330+0000","last_became_peered":"2024-09-17T09:11:56.125330+0000","last_unstale":"2024-09-17T09:11:59.135262+0000","last_undegraded":"2024-09-17T09:11:59.135262+0000","last_fullsized":"2024-09-17T09:11:59.135262+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:12.961337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134754+0000","last_change":"2024-09-17T09:11:58.144993+0000","last_active":"2024-09-17T09:11:59.134754+0000","last_peered":"2024-09-17T09:11:59.134754+0000","last_clean":"2024-09-17T09:11:59.134754+0000","last_became_active":"2024-09-17T09:11:58.144638+0000","last_became_peered":"2024-09-17T09:11:58.144638+0000","last_unstale":"2024-09-17T09:11:59.134754+0000","last_undegraded":"2024-09-17T09:11:59.134754+0000","last_fullsized":"2024-09-17T09:11:59.134754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:34.072483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.259026+0000","last_change":"2024-09-17T09:11:52.108798+0000","last_active":"2024-09-17T09:11:59.259026+0000","last_peered":"2024-09-17T09:11:59.259026+0000","last_clean":"2024-09-17T09:11:59.259026+0000","last_became_active":"2024-09-17T09:11:52.107590+0000","last_became_peered":"2024-09-17T09:11:52.107590+0000","last_unstale":"2024-09-17T09:11:59.259026+0000","last_undegraded":"2024-09-17T09:11:59.259026+0000","last_fullsized":"2024-09-17T09:11:59.259026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:36.840048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.472929+0000","last_change":"2024-09-17T09:11:54.116793+0000","last_active":"2024-09-17T09:11:59.472929+0000","last_peered":"2024-09-17T09:11:59.472929+0000","last_clean":"2024-09-17T09:11:59.472929+0000","last_became_active":"2024-09-17T09:11:54.115159+0000","last_became_peered":"2024-09-17T09:11:54.115159+0000","last_unstale":"2024-09-17T09:11:59.472929+0000","last_undegraded":"2024-09-17T09:11:59.472929+0000","last_fullsized":"2024-09-17T09:11:59.472929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:20.180075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134961+0000","last_change":"2024-09-17T09:11:56.131250+0000","last_active":"2024-09-17T09:11:59.134961+0000","last_peered":"2024-09-17T09:11:59.134961+0000","last_clean":"2024-09-17T09:11:59.134961+0000","last_became_active":"2024-09-17T09:11:56.130901+0000","last_became_peered":"2024-09-17T09:11:56.130901+0000","last_unstale":"2024-09-17T09:11:59.134961+0000","last_undegraded":"2024-09-17T09:11:59.134961+0000","last_fullsized":"2024-09-17T09:11:59.134961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:54.303762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249305+0000","last_change":"2024-09-17T09:11:58.144707+0000","last_active":"2024-09-17T09:11:59.249305+0000","last_peered":"2024-09-17T09:11:59.249305+0000","last_clean":"2024-09-17T09:11:59.249305+0000","last_became_active":"2024-09-17T09:11:58.144266+0000","last_became_peered":"2024-09-17T09:11:58.144266+0000","last_unstale":"2024-09-17T09:11:59.249305+0000","last_undegraded":"2024-09-17T09:11:59.249305+0000","last_fullsized":"2024-09-17T09:11:59.249305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:06:08.852933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136511+0000","last_change":"2024-09-17T09:11:52.108792+0000","last_active":"2024-09-17T09:11:59.136511+0000","last_peered":"2024-09-17T09:11:59.136511+0000","last_clean":"2024-09-17T09:11:59.136511+0000","last_became_active":"2024-09-17T09:11:52.108457+0000","last_became_peered":"2024-09-17T09:11:52.108457+0000","last_unstale":"2024-09-17T09:11:59.136511+0000","last_undegraded":"2024-09-17T09:11:59.136511+0000","last_fullsized":"2024-09-17T09:11:59.136511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:25:47.338321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.412938+0000","last_change":"2024-09-17T09:11:54.118958+0000","last_active":"2024-09-17T09:11:59.412938+0000","last_peered":"2024-09-17T09:11:59.412938+0000","last_clean":"2024-09-17T09:11:59.412938+0000","last_became_active":"2024-09-17T09:11:54.118483+0000","last_became_peered":"2024-09-17T09:11:54.118483+0000","last_unstale":"2024-09-17T09:11:59.412938+0000","last_undegraded":"2024-09-17T09:11:59.412938+0000","last_fullsized":"2024-09-17T09:11:59.412938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:41.538638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136741+0000","last_change":"2024-09-17T09:11:56.127332+0000","last_active":"2024-09-17T09:11:59.136741+0000","last_peered":"2024-09-17T09:11:59.136741+0000","last_clean":"2024-09-17T09:11:59.136741+0000","last_became_active":"2024-09-17T09:11:56.125155+0000","last_became_peered":"2024-09-17T09:11:56.125155+0000","last_unstale":"2024-09-17T09:11:59.136741+0000","last_undegraded":"2024-09-17T09:11:59.136741+0000","last_fullsized":"2024-09-17T09:11:59.136741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:13.502596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648188+0000","last_change":"2024-09-17T09:11:58.145408+0000","last_active":"2024-09-17T09:12:01.648188+0000","last_peered":"2024-09-17T09:12:01.648188+0000","last_clean":"2024-09-17T09:12:01.648188+0000","last_became_active":"2024-09-17T09:11:58.145200+0000","last_became_peered":"2024-09-17T09:11:58.145200+0000","last_unstale":"2024-09-17T09:12:01.648188+0000","last_undegraded":"2024-09-17T09:12:01.648188+0000","last_fullsized":"2024-09-17T09:12:01.648188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:50.676935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135452+0000","last_change":"2024-09-17T09:11:52.108034+0000","last_active":"2024-09-17T09:11:59.135452+0000","last_peered":"2024-09-17T09:11:59.135452+0000","last_clean":"2024-09-17T09:11:59.135452+0000","last_became_active":"2024-09-17T09:11:52.107705+0000","last_became_peered":"2024-09-17T09:11:52.107705+0000","last_unstale":"2024-09-17T09:11:59.135452+0000","last_undegraded":"2024-09-17T09:11:59.135452+0000","last_fullsized":"2024-09-17T09:11:59.135452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:41.697615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"31'12","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.479211+0000","last_change":"2024-09-17T09:11:54.119311+0000","last_active":"2024-09-17T09:11:59.479211+0000","last_peered":"2024-09-17T09:11:59.479211+0000","last_clean":"2024-09-17T09:11:59.479211+0000","last_became_active":"2024-09-17T09:11:54.119084+0000","last_became_peered":"2024-09-17T09:11:54.119084+0000","last_unstale":"2024-09-17T09:11:59.479211+0000","last_undegraded":"2024-09-17T09:11:59.479211+0000","last_fullsized":"2024-09-17T09:11:59.479211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:24:16.210821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136287+0000","last_change":"2024-09-17T09:11:56.130110+0000","last_active":"2024-09-17T09:11:59.136287+0000","last_peered":"2024-09-17T09:11:59.136287+0000","last_clean":"2024-09-17T09:11:59.136287+0000","last_became_active":"2024-09-17T09:11:56.129801+0000","last_became_peered":"2024-09-17T09:11:56.129801+0000","last_unstale":"2024-09-17T09:11:59.136287+0000","last_undegraded":"2024-09-17T09:11:59.136287+0000","last_fullsized":"2024-09-17T09:11:59.136287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:48.546808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135896+0000","last_change":"2024-09-17T09:11:58.143247+0000","last_active":"2024-09-17T09:11:59.135896+0000","last_peered":"2024-09-17T09:11:59.135896+0000","last_clean":"2024-09-17T09:11:59.135896+0000","last_became_active":"2024-09-17T09:11:58.142465+0000","last_became_peered":"2024-09-17T09:11:58.142465+0000","last_unstale":"2024-09-17T09:11:59.135896+0000","last_undegraded":"2024-09-17T09:11:59.135896+0000","last_fullsized":"2024-09-17T09:11:59.135896+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:53:35.335362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'19","reported_seq":47,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.483223+0000","last_change":"2024-09-17T09:11:54.119005+0000","last_active":"2024-09-17T09:11:59.483223+0000","last_peered":"2024-09-17T09:11:59.483223+0000","last_clean":"2024-09-17T09:11:59.483223+0000","last_became_active":"2024-09-17T09:11:54.118566+0000","last_became_peered":"2024-09-17T09:11:54.118566+0000","last_unstale":"2024-09-17T09:11:59.483223+0000","last_undegraded":"2024-09-17T09:11:59.483223+0000","last_fullsized":"2024-09-17T09:11:59.483223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:58:53.657629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135277+0000","last_change":"2024-09-17T09:11:52.108687+0000","last_active":"2024-09-17T09:11:59.135277+0000","last_peered":"2024-09-17T09:11:59.135277+0000","last_clean":"2024-09-17T09:11:59.135277+0000","last_became_active":"2024-09-17T09:11:52.108371+0000","last_became_peered":"2024-09-17T09:11:52.108371+0000","last_unstale":"2024-09-17T09:11:59.135277+0000","last_undegraded":"2024-09-17T09:11:59.135277+0000","last_fullsized":"2024-09-17T09:11:59.135277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:43.904432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"31'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038535+0000","last_change":"2024-09-17T09:11:56.129540+0000","last_active":"2024-09-17T09:12:40.038535+0000","last_peered":"2024-09-17T09:12:40.038535+0000","last_clean":"2024-09-17T09:12:40.038535+0000","last_became_active":"2024-09-17T09:11:56.128967+0000","last_became_peered":"2024-09-17T09:11:56.128967+0000","last_unstale":"2024-09-17T09:12:40.038535+0000","last_undegraded":"2024-09-17T09:12:40.038535+0000","last_fullsized":"2024-09-17T09:12:40.038535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:08:31.886371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249563+0000","last_change":"2024-09-17T09:11:58.143095+0000","last_active":"2024-09-17T09:11:59.249563+0000","last_peered":"2024-09-17T09:11:59.249563+0000","last_clean":"2024-09-17T09:11:59.249563+0000","last_became_active":"2024-09-17T09:11:58.142437+0000","last_became_peered":"2024-09-17T09:11:58.142437+0000","last_unstale":"2024-09-17T09:11:59.249563+0000","last_undegraded":"2024-09-17T09:11:59.249563+0000","last_fullsized":"2024-09-17T09:11:59.249563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:44.158114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.444616+0000","last_change":"2024-09-17T09:11:54.116797+0000","last_active":"2024-09-17T09:11:59.444616+0000","last_peered":"2024-09-17T09:11:59.444616+0000","last_clean":"2024-09-17T09:11:59.444616+0000","last_became_active":"2024-09-17T09:11:54.116116+0000","last_became_peered":"2024-09-17T09:11:54.116116+0000","last_unstale":"2024-09-17T09:11:59.444616+0000","last_undegraded":"2024-09-17T09:11:59.444616+0000","last_fullsized":"2024-09-17T09:11:59.444616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:38:24.794905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135073+0000","last_change":"2024-09-17T09:11:52.111537+0000","last_active":"2024-09-17T09:11:59.135073+0000","last_peered":"2024-09-17T09:11:59.135073+0000","last_clean":"2024-09-17T09:11:59.135073+0000","last_became_active":"2024-09-17T09:11:52.111321+0000","last_became_peered":"2024-09-17T09:11:52.111321+0000","last_unstale":"2024-09-17T09:11:59.135073+0000","last_undegraded":"2024-09-17T09:11:59.135073+0000","last_fullsized":"2024-09-17T09:11:59.135073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:55.581306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136970+0000","last_change":"2024-09-17T09:11:56.127881+0000","last_active":"2024-09-17T09:11:59.136970+0000","last_peered":"2024-09-17T09:11:59.136970+0000","last_clean":"2024-09-17T09:11:59.136970+0000","last_became_active":"2024-09-17T09:11:56.127278+0000","last_became_peered":"2024-09-17T09:11:56.127278+0000","last_unstale":"2024-09-17T09:11:59.136970+0000","last_undegraded":"2024-09-17T09:11:59.136970+0000","last_fullsized":"2024-09-17T09:11:59.136970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:53.678229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648395+0000","last_change":"2024-09-17T09:11:58.148998+0000","last_active":"2024-09-17T09:12:01.648395+0000","last_peered":"2024-09-17T09:12:01.648395+0000","last_clean":"2024-09-17T09:12:01.648395+0000","last_became_active":"2024-09-17T09:11:58.148742+0000","last_became_peered":"2024-09-17T09:11:58.148742+0000","last_unstale":"2024-09-17T09:12:01.648395+0000","last_undegraded":"2024-09-17T09:12:01.648395+0000","last_fullsized":"2024-09-17T09:12:01.648395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:20.881408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.419216+0000","last_change":"2024-09-17T09:11:54.120285+0000","last_active":"2024-09-17T09:11:59.419216+0000","last_peered":"2024-09-17T09:11:59.419216+0000","last_clean":"2024-09-17T09:11:59.419216+0000","last_became_active":"2024-09-17T09:11:54.120027+0000","last_became_peered":"2024-09-17T09:11:54.120027+0000","last_unstale":"2024-09-17T09:11:59.419216+0000","last_undegraded":"2024-09-17T09:11:59.419216+0000","last_fullsized":"2024-09-17T09:11:59.419216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.264767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134544+0000","last_change":"2024-09-17T09:11:52.109155+0000","last_active":"2024-09-17T09:11:59.134544+0000","last_peered":"2024-09-17T09:11:59.134544+0000","last_clean":"2024-09-17T09:11:59.134544+0000","last_became_active":"2024-09-17T09:11:52.107555+0000","last_became_peered":"2024-09-17T09:11:52.107555+0000","last_unstale":"2024-09-17T09:11:59.134544+0000","last_undegraded":"2024-09-17T09:11:59.134544+0000","last_fullsized":"2024-09-17T09:11:59.134544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:19.131412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249870+0000","last_change":"2024-09-17T09:11:56.127696+0000","last_active":"2024-09-17T09:11:59.249870+0000","last_peered":"2024-09-17T09:11:59.249870+0000","last_clean":"2024-09-17T09:11:59.249870+0000","last_became_active":"2024-09-17T09:11:56.127370+0000","last_became_peered":"2024-09-17T09:11:56.127370+0000","last_unstale":"2024-09-17T09:11:59.249870+0000","last_undegraded":"2024-09-17T09:11:59.249870+0000","last_fullsized":"2024-09-17T09:11:59.249870+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:47.876475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648418+0000","last_change":"2024-09-17T09:11:58.148661+0000","last_active":"2024-09-17T09:12:01.648418+0000","last_peered":"2024-09-17T09:12:01.648418+0000","last_clean":"2024-09-17T09:12:01.648418+0000","last_became_active":"2024-09-17T09:11:58.148383+0000","last_became_peered":"2024-09-17T09:11:58.148383+0000","last_unstale":"2024-09-17T09:12:01.648418+0000","last_undegraded":"2024-09-17T09:12:01.648418+0000","last_fullsized":"2024-09-17T09:12:01.648418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:31:17.143882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"31'12","reported_seq":39,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.296709+0000","last_change":"2024-09-17T09:11:54.119916+0000","last_active":"2024-09-17T09:11:59.296709+0000","last_peered":"2024-09-17T09:11:59.296709+0000","last_clean":"2024-09-17T09:11:59.296709+0000","last_became_active":"2024-09-17T09:11:54.119639+0000","last_became_peered":"2024-09-17T09:11:54.119639+0000","last_unstale":"2024-09-17T09:11:59.296709+0000","last_undegraded":"2024-09-17T09:11:59.296709+0000","last_fullsized":"2024-09-17T09:11:59.296709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:13.241739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135297+0000","last_change":"2024-09-17T09:11:52.109233+0000","last_active":"2024-09-17T09:11:59.135297+0000","last_peered":"2024-09-17T09:11:59.135297+0000","last_clean":"2024-09-17T09:11:59.135297+0000","last_became_active":"2024-09-17T09:11:52.108359+0000","last_became_peered":"2024-09-17T09:11:52.108359+0000","last_unstale":"2024-09-17T09:11:59.135297+0000","last_undegraded":"2024-09-17T09:11:59.135297+0000","last_fullsized":"2024-09-17T09:11:59.135297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:13:20.127415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038572+0000","last_change":"2024-09-17T09:11:56.131285+0000","last_active":"2024-09-17T09:12:40.038572+0000","last_peered":"2024-09-17T09:12:40.038572+0000","last_clean":"2024-09-17T09:12:40.038572+0000","last_became_active":"2024-09-17T09:11:56.130892+0000","last_became_peered":"2024-09-17T09:11:56.130892+0000","last_unstale":"2024-09-17T09:12:40.038572+0000","last_undegraded":"2024-09-17T09:12:40.038572+0000","last_fullsized":"2024-09-17T09:12:40.038572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:24:50.185477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136221+0000","last_change":"2024-09-17T09:11:58.143274+0000","last_active":"2024-09-17T09:11:59.136221+0000","last_peered":"2024-09-17T09:11:59.136221+0000","last_clean":"2024-09-17T09:11:59.136221+0000","last_became_active":"2024-09-17T09:11:58.142719+0000","last_became_peered":"2024-09-17T09:11:58.142719+0000","last_unstale":"2024-09-17T09:11:59.136221+0000","last_undegraded":"2024-09-17T09:11:59.136221+0000","last_fullsized":"2024-09-17T09:11:59.136221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:01.641449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"31'12","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.410876+0000","last_change":"2024-09-17T09:11:54.116843+0000","last_active":"2024-09-17T09:11:59.410876+0000","last_peered":"2024-09-17T09:11:59.410876+0000","last_clean":"2024-09-17T09:11:59.410876+0000","last_became_active":"2024-09-17T09:11:54.116100+0000","last_became_peered":"2024-09-17T09:11:54.116100+0000","last_unstale":"2024-09-17T09:11:59.410876+0000","last_undegraded":"2024-09-17T09:11:59.410876+0000","last_fullsized":"2024-09-17T09:11:59.410876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:37.435673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136222+0000","last_change":"2024-09-17T09:11:52.109208+0000","last_active":"2024-09-17T09:11:59.136222+0000","last_peered":"2024-09-17T09:11:59.136222+0000","last_clean":"2024-09-17T09:11:59.136222+0000","last_became_active":"2024-09-17T09:11:52.108367+0000","last_became_peered":"2024-09-17T09:11:52.108367+0000","last_unstale":"2024-09-17T09:11:59.136222+0000","last_undegraded":"2024-09-17T09:11:59.136222+0000","last_fullsized":"2024-09-17T09:11:59.136222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:50.868544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135435+0000","last_change":"2024-09-17T09:11:56.125875+0000","last_active":"2024-09-17T09:11:59.135435+0000","last_peered":"2024-09-17T09:11:59.135435+0000","last_clean":"2024-09-17T09:11:59.135435+0000","last_became_active":"2024-09-17T09:11:56.125582+0000","last_became_peered":"2024-09-17T09:11:56.125582+0000","last_unstale":"2024-09-17T09:11:59.135435+0000","last_undegraded":"2024-09-17T09:11:59.135435+0000","last_fullsized":"2024-09-17T09:11:59.135435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:59.674162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648115+0000","last_change":"2024-09-17T09:11:58.148943+0000","last_active":"2024-09-17T09:12:01.648115+0000","last_peered":"2024-09-17T09:12:01.648115+0000","last_clean":"2024-09-17T09:12:01.648115+0000","last_became_active":"2024-09-17T09:11:58.148537+0000","last_became_peered":"2024-09-17T09:11:58.148537+0000","last_unstale":"2024-09-17T09:12:01.648115+0000","last_undegraded":"2024-09-17T09:12:01.648115+0000","last_fullsized":"2024-09-17T09:12:01.648115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:08:36.622057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"31'13","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.400645+0000","last_change":"2024-09-17T09:11:54.116855+0000","last_active":"2024-09-17T09:11:59.400645+0000","last_peered":"2024-09-17T09:11:59.400645+0000","last_clean":"2024-09-17T09:11:59.400645+0000","last_became_active":"2024-09-17T09:11:54.116421+0000","last_became_peered":"2024-09-17T09:11:54.116421+0000","last_unstale":"2024-09-17T09:11:59.400645+0000","last_undegraded":"2024-09-17T09:11:59.400645+0000","last_fullsized":"2024-09-17T09:11:59.400645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:21.005192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136768+0000","last_change":"2024-09-17T09:11:52.108950+0000","last_active":"2024-09-17T09:11:59.136768+0000","last_peered":"2024-09-17T09:11:59.136768+0000","last_clean":"2024-09-17T09:11:59.136768+0000","last_became_active":"2024-09-17T09:11:52.108382+0000","last_became_peered":"2024-09-17T09:11:52.108382+0000","last_unstale":"2024-09-17T09:11:59.136768+0000","last_undegraded":"2024-09-17T09:11:59.136768+0000","last_fullsized":"2024-09-17T09:11:59.136768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:27:32.433107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"31'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038482+0000","last_change":"2024-09-17T09:11:56.129229+0000","last_active":"2024-09-17T09:12:40.038482+0000","last_peered":"2024-09-17T09:12:40.038482+0000","last_clean":"2024-09-17T09:12:40.038482+0000","last_became_active":"2024-09-17T09:11:56.128623+0000","last_became_peered":"2024-09-17T09:11:56.128623+0000","last_unstale":"2024-09-17T09:12:40.038482+0000","last_undegraded":"2024-09-17T09:12:40.038482+0000","last_fullsized":"2024-09-17T09:12:40.038482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:42.004345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135539+0000","last_change":"2024-09-17T09:11:58.143109+0000","last_active":"2024-09-17T09:11:59.135539+0000","last_peered":"2024-09-17T09:11:59.135539+0000","last_clean":"2024-09-17T09:11:59.135539+0000","last_became_active":"2024-09-17T09:11:58.141984+0000","last_became_peered":"2024-09-17T09:11:58.141984+0000","last_unstale":"2024-09-17T09:11:59.135539+0000","last_undegraded":"2024-09-17T09:11:59.135539+0000","last_fullsized":"2024-09-17T09:11:59.135539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:29:50.613933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"31'28","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038433+0000","last_change":"2024-09-17T09:11:54.116540+0000","last_active":"2024-09-17T09:12:40.038433+0000","last_peered":"2024-09-17T09:12:40.038433+0000","last_clean":"2024-09-17T09:12:40.038433+0000","last_became_active":"2024-09-17T09:11:54.115856+0000","last_became_peered":"2024-09-17T09:11:54.115856+0000","last_unstale":"2024-09-17T09:12:40.038433+0000","last_undegraded":"2024-09-17T09:12:40.038433+0000","last_fullsized":"2024-09-17T09:12:40.038433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:26:38.399585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135859+0000","last_change":"2024-09-17T09:11:52.112124+0000","last_active":"2024-09-17T09:11:59.135859+0000","last_peered":"2024-09-17T09:11:59.135859+0000","last_clean":"2024-09-17T09:11:59.135859+0000","last_became_active":"2024-09-17T09:11:52.111856+0000","last_became_peered":"2024-09-17T09:11:52.111856+0000","last_unstale":"2024-09-17T09:11:59.135859+0000","last_undegraded":"2024-09-17T09:11:59.135859+0000","last_fullsized":"2024-09-17T09:11:59.135859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:43.411338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"31'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038434+0000","last_change":"2024-09-17T09:11:56.124835+0000","last_active":"2024-09-17T09:12:40.038434+0000","last_peered":"2024-09-17T09:12:40.038434+0000","last_clean":"2024-09-17T09:12:40.038434+0000","last_became_active":"2024-09-17T09:11:56.124520+0000","last_became_peered":"2024-09-17T09:11:56.124520+0000","last_unstale":"2024-09-17T09:12:40.038434+0000","last_undegraded":"2024-09-17T09:12:40.038434+0000","last_fullsized":"2024-09-17T09:12:40.038434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:34:35.630280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136175+0000","last_change":"2024-09-17T09:11:58.143642+0000","last_active":"2024-09-17T09:11:59.136175+0000","last_peered":"2024-09-17T09:11:59.136175+0000","last_clean":"2024-09-17T09:11:59.136175+0000","last_became_active":"2024-09-17T09:11:58.143266+0000","last_became_peered":"2024-09-17T09:11:58.143266+0000","last_unstale":"2024-09-17T09:11:59.136175+0000","last_undegraded":"2024-09-17T09:11:59.136175+0000","last_fullsized":"2024-09-17T09:11:59.136175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:47:12.764164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"31'14","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.459740+0000","last_change":"2024-09-17T09:11:54.118976+0000","last_active":"2024-09-17T09:11:59.459740+0000","last_peered":"2024-09-17T09:11:59.459740+0000","last_clean":"2024-09-17T09:11:59.459740+0000","last_became_active":"2024-09-17T09:11:54.118481+0000","last_became_peered":"2024-09-17T09:11:54.118481+0000","last_unstale":"2024-09-17T09:11:59.459740+0000","last_undegraded":"2024-09-17T09:11:59.459740+0000","last_fullsized":"2024-09-17T09:11:59.459740+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:43:36.400650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135194+0000","last_change":"2024-09-17T09:11:52.108488+0000","last_active":"2024-09-17T09:11:59.135194+0000","last_peered":"2024-09-17T09:11:59.135194+0000","last_clean":"2024-09-17T09:11:59.135194+0000","last_became_active":"2024-09-17T09:11:52.108213+0000","last_became_peered":"2024-09-17T09:11:52.108213+0000","last_unstale":"2024-09-17T09:11:59.135194+0000","last_undegraded":"2024-09-17T09:11:59.135194+0000","last_fullsized":"2024-09-17T09:11:59.135194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:28:46.762752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135618+0000","last_change":"2024-09-17T09:11:56.126488+0000","last_active":"2024-09-17T09:11:59.135618+0000","last_peered":"2024-09-17T09:11:59.135618+0000","last_clean":"2024-09-17T09:11:59.135618+0000","last_became_active":"2024-09-17T09:11:56.126144+0000","last_became_peered":"2024-09-17T09:11:56.126144+0000","last_unstale":"2024-09-17T09:11:59.135618+0000","last_undegraded":"2024-09-17T09:11:59.135618+0000","last_fullsized":"2024-09-17T09:11:59.135618+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:19.746708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249513+0000","last_change":"2024-09-17T09:11:58.142433+0000","last_active":"2024-09-17T09:11:59.249513+0000","last_peered":"2024-09-17T09:11:59.249513+0000","last_clean":"2024-09-17T09:11:59.249513+0000","last_became_active":"2024-09-17T09:11:58.141948+0000","last_became_peered":"2024-09-17T09:11:58.141948+0000","last_unstale":"2024-09-17T09:11:59.249513+0000","last_undegraded":"2024-09-17T09:11:59.249513+0000","last_fullsized":"2024-09-17T09:11:59.249513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:54.032343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"31'19","reported_seq":52,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.449045+0000","last_change":"2024-09-17T09:11:54.117806+0000","last_active":"2024-09-17T09:11:59.449045+0000","last_peered":"2024-09-17T09:11:59.449045+0000","last_clean":"2024-09-17T09:11:59.449045+0000","last_became_active":"2024-09-17T09:11:54.117497+0000","last_became_peered":"2024-09-17T09:11:54.117497+0000","last_unstale":"2024-09-17T09:11:59.449045+0000","last_undegraded":"2024-09-17T09:11:59.449045+0000","last_fullsized":"2024-09-17T09:11:59.449045+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:45:52.473697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135115+0000","last_change":"2024-09-17T09:11:52.108119+0000","last_active":"2024-09-17T09:11:59.135115+0000","last_peered":"2024-09-17T09:11:59.135115+0000","last_clean":"2024-09-17T09:11:59.135115+0000","last_became_active":"2024-09-17T09:11:52.107412+0000","last_became_peered":"2024-09-17T09:11:52.107412+0000","last_unstale":"2024-09-17T09:11:59.135115+0000","last_undegraded":"2024-09-17T09:11:59.135115+0000","last_fullsized":"2024-09-17T09:11:59.135115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:49.079925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249596+0000","last_change":"2024-09-17T09:11:56.127117+0000","last_active":"2024-09-17T09:11:59.249596+0000","last_peered":"2024-09-17T09:11:59.249596+0000","last_clean":"2024-09-17T09:11:59.249596+0000","last_became_active":"2024-09-17T09:11:56.126828+0000","last_became_peered":"2024-09-17T09:11:56.126828+0000","last_unstale":"2024-09-17T09:11:59.249596+0000","last_undegraded":"2024-09-17T09:11:59.249596+0000","last_fullsized":"2024-09-17T09:11:59.249596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:47.132842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249635+0000","last_change":"2024-09-17T09:11:58.142922+0000","last_active":"2024-09-17T09:11:59.249635+0000","last_peered":"2024-09-17T09:11:59.249635+0000","last_clean":"2024-09-17T09:11:59.249635+0000","last_became_active":"2024-09-17T09:11:58.142369+0000","last_became_peered":"2024-09-17T09:11:58.142369+0000","last_unstale":"2024-09-17T09:11:59.249635+0000","last_undegraded":"2024-09-17T09:11:59.249635+0000","last_fullsized":"2024-09-17T09:11:59.249635+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:27.624464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"31'18","reported_seq":48,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.437898+0000","last_change":"2024-09-17T09:11:54.116050+0000","last_active":"2024-09-17T09:11:59.437898+0000","last_peered":"2024-09-17T09:11:59.437898+0000","last_clean":"2024-09-17T09:11:59.437898+0000","last_became_active":"2024-09-17T09:11:54.115714+0000","last_became_peered":"2024-09-17T09:11:54.115714+0000","last_unstale":"2024-09-17T09:11:59.437898+0000","last_undegraded":"2024-09-17T09:11:59.437898+0000","last_fullsized":"2024-09-17T09:11:59.437898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:56:12.193429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134390+0000","last_change":"2024-09-17T09:11:52.109321+0000","last_active":"2024-09-17T09:11:59.134390+0000","last_peered":"2024-09-17T09:11:59.134390+0000","last_clean":"2024-09-17T09:11:59.134390+0000","last_became_active":"2024-09-17T09:11:52.109005+0000","last_became_peered":"2024-09-17T09:11:52.109005+0000","last_unstale":"2024-09-17T09:11:59.134390+0000","last_undegraded":"2024-09-17T09:11:59.134390+0000","last_fullsized":"2024-09-17T09:11:59.134390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:01:37.612746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249812+0000","last_change":"2024-09-17T09:11:56.128545+0000","last_active":"2024-09-17T09:11:59.249812+0000","last_peered":"2024-09-17T09:11:59.249812+0000","last_clean":"2024-09-17T09:11:59.249812+0000","last_became_active":"2024-09-17T09:11:56.128170+0000","last_became_peered":"2024-09-17T09:11:56.128170+0000","last_unstale":"2024-09-17T09:11:59.249812+0000","last_undegraded":"2024-09-17T09:11:59.249812+0000","last_fullsized":"2024-09-17T09:11:59.249812+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:56.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249740+0000","last_change":"2024-09-17T09:11:58.142388+0000","last_active":"2024-09-17T09:11:59.249740+0000","last_peered":"2024-09-17T09:11:59.249740+0000","last_clean":"2024-09-17T09:11:59.249740+0000","last_became_active":"2024-09-17T09:11:58.141986+0000","last_became_peered":"2024-09-17T09:11:58.141986+0000","last_unstale":"2024-09-17T09:11:59.249740+0000","last_undegraded":"2024-09-17T09:11:59.249740+0000","last_fullsized":"2024-09-17T09:11:59.249740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:48:57.301555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"31'14","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.468649+0000","last_change":"2024-09-17T09:11:54.117083+0000","last_active":"2024-09-17T09:11:59.468649+0000","last_peered":"2024-09-17T09:11:59.468649+0000","last_clean":"2024-09-17T09:11:59.468649+0000","last_became_active":"2024-09-17T09:11:54.116397+0000","last_became_peered":"2024-09-17T09:11:54.116397+0000","last_unstale":"2024-09-17T09:11:59.468649+0000","last_undegraded":"2024-09-17T09:11:59.468649+0000","last_fullsized":"2024-09-17T09:11:59.468649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:23:41.363233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135010+0000","last_change":"2024-09-17T09:11:52.109521+0000","last_active":"2024-09-17T09:11:59.135010+0000","last_peered":"2024-09-17T09:11:59.135010+0000","last_clean":"2024-09-17T09:11:59.135010+0000","last_became_active":"2024-09-17T09:11:52.109260+0000","last_became_peered":"2024-09-17T09:11:52.109260+0000","last_unstale":"2024-09-17T09:11:59.135010+0000","last_undegraded":"2024-09-17T09:11:59.135010+0000","last_fullsized":"2024-09-17T09:11:59.135010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:51.134965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136402+0000","last_change":"2024-09-17T09:11:56.125617+0000","last_active":"2024-09-17T09:11:59.136402+0000","last_peered":"2024-09-17T09:11:59.136402+0000","last_clean":"2024-09-17T09:11:59.136402+0000","last_became_active":"2024-09-17T09:11:56.125228+0000","last_became_peered":"2024-09-17T09:11:56.125228+0000","last_unstale":"2024-09-17T09:11:59.136402+0000","last_undegraded":"2024-09-17T09:11:59.136402+0000","last_fullsized":"2024-09-17T09:11:59.136402+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:57:20.912266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136880+0000","last_change":"2024-09-17T09:11:58.143114+0000","last_active":"2024-09-17T09:11:59.136880+0000","last_peered":"2024-09-17T09:11:59.136880+0000","last_clean":"2024-09-17T09:11:59.136880+0000","last_became_active":"2024-09-17T09:11:58.142285+0000","last_became_peered":"2024-09-17T09:11:58.142285+0000","last_unstale":"2024-09-17T09:11:59.136880+0000","last_undegraded":"2024-09-17T09:11:59.136880+0000","last_fullsized":"2024-09-17T09:11:59.136880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:49.183728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.455583+0000","last_change":"2024-09-17T09:11:54.115414+0000","last_active":"2024-09-17T09:11:59.455583+0000","last_peered":"2024-09-17T09:11:59.455583+0000","last_clean":"2024-09-17T09:11:59.455583+0000","last_became_active":"2024-09-17T09:11:54.115083+0000","last_became_peered":"2024-09-17T09:11:54.115083+0000","last_unstale":"2024-09-17T09:11:59.455583+0000","last_undegraded":"2024-09-17T09:11:59.455583+0000","last_fullsized":"2024-09-17T09:11:59.455583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:32.358470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135665+0000","last_change":"2024-09-17T09:11:52.108341+0000","last_active":"2024-09-17T09:11:59.135665+0000","last_peered":"2024-09-17T09:11:59.135665+0000","last_clean":"2024-09-17T09:11:59.135665+0000","last_became_active":"2024-09-17T09:11:52.108051+0000","last_became_peered":"2024-09-17T09:11:52.108051+0000","last_unstale":"2024-09-17T09:11:59.135665+0000","last_undegraded":"2024-09-17T09:11:59.135665+0000","last_fullsized":"2024-09-17T09:11:59.135665+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:07:09.070797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"32'208","reported_seq":302,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:22.494137+0000","last_change":"2024-09-17T09:11:39.657340+0000","last_active":"2024-09-17T09:12:22.494137+0000","last_peered":"2024-09-17T09:12:22.494137+0000","last_clean":"2024-09-17T09:12:22.494137+0000","last_became_active":"2024-09-17T09:11:39.657023+0000","last_became_peered":"2024-09-17T09:11:39.657023+0000","last_unstale":"2024-09-17T09:12:22.494137+0000","last_undegraded":"2024-09-17T09:12:22.494137+0000","last_fullsized":"2024-09-17T09:12:22.494137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:38.644290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:38.644290+0000","last_clean_scrub_stamp":"2024-09-17T09:11:38.644290+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:49.680832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":342,"num_write":267,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136784+0000","last_change":"2024-09-17T09:11:56.129619+0000","last_active":"2024-09-17T09:11:59.136784+0000","last_peered":"2024-09-17T09:11:59.136784+0000","last_clean":"2024-09-17T09:11:59.136784+0000","last_became_active":"2024-09-17T09:11:56.128883+0000","last_became_peered":"2024-09-17T09:11:56.128883+0000","last_unstale":"2024-09-17T09:11:59.136784+0000","last_undegraded":"2024-09-17T09:11:59.136784+0000","last_fullsized":"2024-09-17T09:11:59.136784+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:21:08.642080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648309+0000","last_change":"2024-09-17T09:11:58.149029+0000","last_active":"2024-09-17T09:12:01.648309+0000","last_peered":"2024-09-17T09:12:01.648309+0000","last_clean":"2024-09-17T09:12:01.648309+0000","last_became_active":"2024-09-17T09:11:58.148229+0000","last_became_peered":"2024-09-17T09:11:58.148229+0000","last_unstale":"2024-09-17T09:12:01.648309+0000","last_undegraded":"2024-09-17T09:12:01.648309+0000","last_fullsized":"2024-09-17T09:12:01.648309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:23.011113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"31'17","reported_seq":44,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.461845+0000","last_change":"2024-09-17T09:11:54.118211+0000","last_active":"2024-09-17T09:11:59.461845+0000","last_peered":"2024-09-17T09:11:59.461845+0000","last_clean":"2024-09-17T09:11:59.461845+0000","last_became_active":"2024-09-17T09:11:54.117828+0000","last_became_peered":"2024-09-17T09:11:54.117828+0000","last_unstale":"2024-09-17T09:11:59.461845+0000","last_undegraded":"2024-09-17T09:11:59.461845+0000","last_fullsized":"2024-09-17T09:11:59.461845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:52:16.416349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135435+0000","last_change":"2024-09-17T09:11:52.111870+0000","last_active":"2024-09-17T09:11:59.135435+0000","last_peered":"2024-09-17T09:11:59.135435+0000","last_clean":"2024-09-17T09:11:59.135435+0000","last_became_active":"2024-09-17T09:11:52.111625+0000","last_became_peered":"2024-09-17T09:11:52.111625+0000","last_unstale":"2024-09-17T09:11:59.135435+0000","last_undegraded":"2024-09-17T09:11:59.135435+0000","last_fullsized":"2024-09-17T09:11:59.135435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:33:43.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135585+0000","last_change":"2024-09-17T09:11:56.129208+0000","last_active":"2024-09-17T09:11:59.135585+0000","last_peered":"2024-09-17T09:11:59.135585+0000","last_clean":"2024-09-17T09:11:59.135585+0000","last_became_active":"2024-09-17T09:11:56.128698+0000","last_became_peered":"2024-09-17T09:11:56.128698+0000","last_unstale":"2024-09-17T09:11:59.135585+0000","last_undegraded":"2024-09-17T09:11:59.135585+0000","last_fullsized":"2024-09-17T09:11:59.135585+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:30.532352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648278+0000","last_change":"2024-09-17T09:11:58.148691+0000","last_active":"2024-09-17T09:12:01.648278+0000","last_peered":"2024-09-17T09:12:01.648278+0000","last_clean":"2024-09-17T09:12:01.648278+0000","last_became_active":"2024-09-17T09:11:58.148284+0000","last_became_peered":"2024-09-17T09:11:58.148284+0000","last_unstale":"2024-09-17T09:12:01.648278+0000","last_undegraded":"2024-09-17T09:12:01.648278+0000","last_fullsized":"2024-09-17T09:12:01.648278+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:55:57.549638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.421841+0000","last_change":"2024-09-17T09:11:54.117845+0000","last_active":"2024-09-17T09:11:59.421841+0000","last_peered":"2024-09-17T09:11:59.421841+0000","last_clean":"2024-09-17T09:11:59.421841+0000","last_became_active":"2024-09-17T09:11:54.117444+0000","last_became_peered":"2024-09-17T09:11:54.117444+0000","last_unstale":"2024-09-17T09:11:59.421841+0000","last_undegraded":"2024-09-17T09:11:59.421841+0000","last_fullsized":"2024-09-17T09:11:59.421841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:40.681048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136169+0000","last_change":"2024-09-17T09:11:52.108166+0000","last_active":"2024-09-17T09:11:59.136169+0000","last_peered":"2024-09-17T09:11:59.136169+0000","last_clean":"2024-09-17T09:11:59.136169+0000","last_became_active":"2024-09-17T09:11:52.107896+0000","last_became_peered":"2024-09-17T09:11:52.107896+0000","last_unstale":"2024-09-17T09:11:59.136169+0000","last_undegraded":"2024-09-17T09:11:59.136169+0000","last_fullsized":"2024-09-17T09:11:59.136169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:59:20.037773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249480+0000","last_change":"2024-09-17T09:11:56.126406+0000","last_active":"2024-09-17T09:11:59.249480+0000","last_peered":"2024-09-17T09:11:59.249480+0000","last_clean":"2024-09-17T09:11:59.249480+0000","last_became_active":"2024-09-17T09:11:56.126095+0000","last_became_peered":"2024-09-17T09:11:56.126095+0000","last_unstale":"2024-09-17T09:11:59.249480+0000","last_undegraded":"2024-09-17T09:11:59.249480+0000","last_fullsized":"2024-09-17T09:11:59.249480+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:37:33.759479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249400+0000","last_change":"2024-09-17T09:11:58.142801+0000","last_active":"2024-09-17T09:11:59.249400+0000","last_peered":"2024-09-17T09:11:59.249400+0000","last_clean":"2024-09-17T09:11:59.249400+0000","last_became_active":"2024-09-17T09:11:58.141974+0000","last_became_peered":"2024-09-17T09:11:58.141974+0000","last_unstale":"2024-09-17T09:11:59.249400+0000","last_undegraded":"2024-09-17T09:11:59.249400+0000","last_fullsized":"2024-09-17T09:11:59.249400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:45:22.651516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.485456+0000","last_change":"2024-09-17T09:11:54.119139+0000","last_active":"2024-09-17T09:11:59.485456+0000","last_peered":"2024-09-17T09:11:59.485456+0000","last_clean":"2024-09-17T09:11:59.485456+0000","last_became_active":"2024-09-17T09:11:54.118788+0000","last_became_peered":"2024-09-17T09:11:54.118788+0000","last_unstale":"2024-09-17T09:11:59.485456+0000","last_undegraded":"2024-09-17T09:11:59.485456+0000","last_fullsized":"2024-09-17T09:11:59.485456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:57:24.625528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136774+0000","last_change":"2024-09-17T09:11:52.109022+0000","last_active":"2024-09-17T09:11:59.136774+0000","last_peered":"2024-09-17T09:11:59.136774+0000","last_clean":"2024-09-17T09:11:59.136774+0000","last_became_active":"2024-09-17T09:11:52.108447+0000","last_became_peered":"2024-09-17T09:11:52.108447+0000","last_unstale":"2024-09-17T09:11:59.136774+0000","last_undegraded":"2024-09-17T09:11:59.136774+0000","last_fullsized":"2024-09-17T09:11:59.136774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:27:55.022854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136482+0000","last_change":"2024-09-17T09:11:56.126521+0000","last_active":"2024-09-17T09:11:59.136482+0000","last_peered":"2024-09-17T09:11:59.136482+0000","last_clean":"2024-09-17T09:11:59.136482+0000","last_became_active":"2024-09-17T09:11:56.126284+0000","last_became_peered":"2024-09-17T09:11:56.126284+0000","last_unstale":"2024-09-17T09:11:59.136482+0000","last_undegraded":"2024-09-17T09:11:59.136482+0000","last_fullsized":"2024-09-17T09:11:59.136482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:18.361988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134912+0000","last_change":"2024-09-17T09:11:58.142837+0000","last_active":"2024-09-17T09:11:59.134912+0000","last_peered":"2024-09-17T09:11:59.134912+0000","last_clean":"2024-09-17T09:11:59.134912+0000","last_became_active":"2024-09-17T09:11:58.142086+0000","last_became_peered":"2024-09-17T09:11:58.142086+0000","last_unstale":"2024-09-17T09:11:59.134912+0000","last_undegraded":"2024-09-17T09:11:59.134912+0000","last_fullsized":"2024-09-17T09:11:59.134912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:10.067505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.463859+0000","last_change":"2024-09-17T09:11:54.120112+0000","last_active":"2024-09-17T09:11:59.463859+0000","last_peered":"2024-09-17T09:11:59.463859+0000","last_clean":"2024-09-17T09:11:59.463859+0000","last_became_active":"2024-09-17T09:11:54.119865+0000","last_became_peered":"2024-09-17T09:11:54.119865+0000","last_unstale":"2024-09-17T09:11:59.463859+0000","last_undegraded":"2024-09-17T09:11:59.463859+0000","last_fullsized":"2024-09-17T09:11:59.463859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:01.165597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.258556+0000","last_change":"2024-09-17T09:11:52.108141+0000","last_active":"2024-09-17T09:11:59.258556+0000","last_peered":"2024-09-17T09:11:59.258556+0000","last_clean":"2024-09-17T09:11:59.258556+0000","last_became_active":"2024-09-17T09:11:52.107629+0000","last_became_peered":"2024-09-17T09:11:52.107629+0000","last_unstale":"2024-09-17T09:11:59.258556+0000","last_undegraded":"2024-09-17T09:11:59.258556+0000","last_fullsized":"2024-09-17T09:11:59.258556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:58:47.540645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"31'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038486+0000","last_change":"2024-09-17T09:11:56.126399+0000","last_active":"2024-09-17T09:12:40.038486+0000","last_peered":"2024-09-17T09:12:40.038486+0000","last_clean":"2024-09-17T09:12:40.038486+0000","last_became_active":"2024-09-17T09:11:56.126058+0000","last_became_peered":"2024-09-17T09:11:56.126058+0000","last_unstale":"2024-09-17T09:12:40.038486+0000","last_undegraded":"2024-09-17T09:12:40.038486+0000","last_fullsized":"2024-09-17T09:12:40.038486+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:07.392282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648096+0000","last_change":"2024-09-17T09:11:58.148785+0000","last_active":"2024-09-17T09:12:01.648096+0000","last_peered":"2024-09-17T09:12:01.648096+0000","last_clean":"2024-09-17T09:12:01.648096+0000","last_became_active":"2024-09-17T09:11:58.148169+0000","last_became_peered":"2024-09-17T09:11:58.148169+0000","last_unstale":"2024-09-17T09:12:01.648096+0000","last_undegraded":"2024-09-17T09:12:01.648096+0000","last_fullsized":"2024-09-17T09:12:01.648096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:49:24.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.470611+0000","last_change":"2024-09-17T09:11:54.119838+0000","last_active":"2024-09-17T09:11:59.470611+0000","last_peered":"2024-09-17T09:11:59.470611+0000","last_clean":"2024-09-17T09:11:59.470611+0000","last_became_active":"2024-09-17T09:11:54.119178+0000","last_became_peered":"2024-09-17T09:11:54.119178+0000","last_unstale":"2024-09-17T09:11:59.470611+0000","last_undegraded":"2024-09-17T09:11:59.470611+0000","last_fullsized":"2024-09-17T09:11:59.470611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:09.214283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135105+0000","last_change":"2024-09-17T09:11:52.108043+0000","last_active":"2024-09-17T09:11:59.135105+0000","last_peered":"2024-09-17T09:11:59.135105+0000","last_clean":"2024-09-17T09:11:59.135105+0000","last_became_active":"2024-09-17T09:11:52.107742+0000","last_became_peered":"2024-09-17T09:11:52.107742+0000","last_unstale":"2024-09-17T09:11:59.135105+0000","last_undegraded":"2024-09-17T09:11:59.135105+0000","last_fullsized":"2024-09-17T09:11:59.135105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:23.515666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249715+0000","last_change":"2024-09-17T09:11:56.128847+0000","last_active":"2024-09-17T09:11:59.249715+0000","last_peered":"2024-09-17T09:11:59.249715+0000","last_clean":"2024-09-17T09:11:59.249715+0000","last_became_active":"2024-09-17T09:11:56.128516+0000","last_became_peered":"2024-09-17T09:11:56.128516+0000","last_unstale":"2024-09-17T09:11:59.249715+0000","last_undegraded":"2024-09-17T09:11:59.249715+0000","last_fullsized":"2024-09-17T09:11:59.249715+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:46.253270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249776+0000","last_change":"2024-09-17T09:11:58.143662+0000","last_active":"2024-09-17T09:11:59.249776+0000","last_peered":"2024-09-17T09:11:59.249776+0000","last_clean":"2024-09-17T09:11:59.249776+0000","last_became_active":"2024-09-17T09:11:58.143296+0000","last_became_peered":"2024-09-17T09:11:58.143296+0000","last_unstale":"2024-09-17T09:11:59.249776+0000","last_undegraded":"2024-09-17T09:11:59.249776+0000","last_fullsized":"2024-09-17T09:11:59.249776+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:31:33.820585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'4","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.298859+0000","last_change":"2024-09-17T09:11:54.118130+0000","last_active":"2024-09-17T09:11:59.298859+0000","last_peered":"2024-09-17T09:11:59.298859+0000","last_clean":"2024-09-17T09:11:59.298859+0000","last_became_active":"2024-09-17T09:11:54.117100+0000","last_became_peered":"2024-09-17T09:11:54.117100+0000","last_unstale":"2024-09-17T09:11:59.298859+0000","last_undegraded":"2024-09-17T09:11:59.298859+0000","last_fullsized":"2024-09-17T09:11:59.298859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:49:00.385969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134913+0000","last_change":"2024-09-17T09:11:52.107660+0000","last_active":"2024-09-17T09:11:59.134913+0000","last_peered":"2024-09-17T09:11:59.134913+0000","last_clean":"2024-09-17T09:11:59.134913+0000","last_became_active":"2024-09-17T09:11:52.106779+0000","last_became_peered":"2024-09-17T09:11:52.106779+0000","last_unstale":"2024-09-17T09:11:59.134913+0000","last_undegraded":"2024-09-17T09:11:59.134913+0000","last_fullsized":"2024-09-17T09:11:59.134913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:36.247919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249891+0000","last_change":"2024-09-17T09:11:56.128353+0000","last_active":"2024-09-17T09:11:59.249891+0000","last_peered":"2024-09-17T09:11:59.249891+0000","last_clean":"2024-09-17T09:11:59.249891+0000","last_became_active":"2024-09-17T09:11:56.128065+0000","last_became_peered":"2024-09-17T09:11:56.128065+0000","last_unstale":"2024-09-17T09:11:59.249891+0000","last_undegraded":"2024-09-17T09:11:59.249891+0000","last_fullsized":"2024-09-17T09:11:59.249891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:31.627465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.137156+0000","last_change":"2024-09-17T09:11:58.142879+0000","last_active":"2024-09-17T09:11:59.137156+0000","last_peered":"2024-09-17T09:11:59.137156+0000","last_clean":"2024-09-17T09:11:59.137156+0000","last_became_active":"2024-09-17T09:11:58.142481+0000","last_became_peered":"2024-09-17T09:11:58.142481+0000","last_unstale":"2024-09-17T09:11:59.137156+0000","last_undegraded":"2024-09-17T09:11:59.137156+0000","last_fullsized":"2024-09-17T09:11:59.137156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:14.095658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"31'11","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.442169+0000","last_change":"2024-09-17T09:11:54.117271+0000","last_active":"2024-09-17T09:11:59.442169+0000","last_peered":"2024-09-17T09:11:59.442169+0000","last_clean":"2024-09-17T09:11:59.442169+0000","last_became_active":"2024-09-17T09:11:54.116778+0000","last_became_peered":"2024-09-17T09:11:54.116778+0000","last_unstale":"2024-09-17T09:11:59.442169+0000","last_undegraded":"2024-09-17T09:11:59.442169+0000","last_fullsized":"2024-09-17T09:11:59.442169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:28.810074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135261+0000","last_change":"2024-09-17T09:11:52.111701+0000","last_active":"2024-09-17T09:11:59.135261+0000","last_peered":"2024-09-17T09:11:59.135261+0000","last_clean":"2024-09-17T09:11:59.135261+0000","last_became_active":"2024-09-17T09:11:52.111417+0000","last_became_peered":"2024-09-17T09:11:52.111417+0000","last_unstale":"2024-09-17T09:11:59.135261+0000","last_undegraded":"2024-09-17T09:11:59.135261+0000","last_fullsized":"2024-09-17T09:11:59.135261+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:08:36.145798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038454+0000","last_change":"2024-09-17T09:11:56.125582+0000","last_active":"2024-09-17T09:12:40.038454+0000","last_peered":"2024-09-17T09:12:40.038454+0000","last_clean":"2024-09-17T09:12:40.038454+0000","last_became_active":"2024-09-17T09:11:56.125274+0000","last_became_peered":"2024-09-17T09:11:56.125274+0000","last_unstale":"2024-09-17T09:12:40.038454+0000","last_undegraded":"2024-09-17T09:12:40.038454+0000","last_fullsized":"2024-09-17T09:12:40.038454+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:45:31.159989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.137234+0000","last_change":"2024-09-17T09:11:58.143489+0000","last_active":"2024-09-17T09:11:59.137234+0000","last_peered":"2024-09-17T09:11:59.137234+0000","last_clean":"2024-09-17T09:11:59.137234+0000","last_became_active":"2024-09-17T09:11:58.142183+0000","last_became_peered":"2024-09-17T09:11:58.142183+0000","last_unstale":"2024-09-17T09:11:59.137234+0000","last_undegraded":"2024-09-17T09:11:59.137234+0000","last_fullsized":"2024-09-17T09:11:59.137234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:34.612104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.376078+0000","last_change":"2024-09-17T09:11:54.116486+0000","last_active":"2024-09-17T09:11:59.376078+0000","last_peered":"2024-09-17T09:11:59.376078+0000","last_clean":"2024-09-17T09:11:59.376078+0000","last_became_active":"2024-09-17T09:11:54.116177+0000","last_became_peered":"2024-09-17T09:11:54.116177+0000","last_unstale":"2024-09-17T09:11:59.376078+0000","last_undegraded":"2024-09-17T09:11:59.376078+0000","last_fullsized":"2024-09-17T09:11:59.376078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:05.593001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135355+0000","last_change":"2024-09-17T09:11:52.108255+0000","last_active":"2024-09-17T09:11:59.135355+0000","last_peered":"2024-09-17T09:11:59.135355+0000","last_clean":"2024-09-17T09:11:59.135355+0000","last_became_active":"2024-09-17T09:11:52.107915+0000","last_became_peered":"2024-09-17T09:11:52.107915+0000","last_unstale":"2024-09-17T09:11:59.135355+0000","last_undegraded":"2024-09-17T09:11:59.135355+0000","last_fullsized":"2024-09-17T09:11:59.135355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T18:21:39.311632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"31'8","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038476+0000","last_change":"2024-09-17T09:11:56.124810+0000","last_active":"2024-09-17T09:12:40.038476+0000","last_peered":"2024-09-17T09:12:40.038476+0000","last_clean":"2024-09-17T09:12:40.038476+0000","last_became_active":"2024-09-17T09:11:56.124531+0000","last_became_peered":"2024-09-17T09:11:56.124531+0000","last_unstale":"2024-09-17T09:12:40.038476+0000","last_undegraded":"2024-09-17T09:12:40.038476+0000","last_fullsized":"2024-09-17T09:12:40.038476+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:54.271581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249533+0000","last_change":"2024-09-17T09:11:58.144727+0000","last_active":"2024-09-17T09:11:59.249533+0000","last_peered":"2024-09-17T09:11:59.249533+0000","last_clean":"2024-09-17T09:11:59.249533+0000","last_became_active":"2024-09-17T09:11:58.143822+0000","last_became_peered":"2024-09-17T09:11:58.143822+0000","last_unstale":"2024-09-17T09:11:59.249533+0000","last_undegraded":"2024-09-17T09:11:59.249533+0000","last_fullsized":"2024-09-17T09:11:59.249533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:59:36.926154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.452826+0000","last_change":"2024-09-17T09:11:54.120092+0000","last_active":"2024-09-17T09:11:59.452826+0000","last_peered":"2024-09-17T09:11:59.452826+0000","last_clean":"2024-09-17T09:11:59.452826+0000","last_became_active":"2024-09-17T09:11:54.119553+0000","last_became_peered":"2024-09-17T09:11:54.119553+0000","last_unstale":"2024-09-17T09:11:59.452826+0000","last_undegraded":"2024-09-17T09:11:59.452826+0000","last_fullsized":"2024-09-17T09:11:59.452826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:03.392330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135658+0000","last_change":"2024-09-17T09:11:52.108316+0000","last_active":"2024-09-17T09:11:59.135658+0000","last_peered":"2024-09-17T09:11:59.135658+0000","last_clean":"2024-09-17T09:11:59.135658+0000","last_became_active":"2024-09-17T09:11:52.107986+0000","last_became_peered":"2024-09-17T09:11:52.107986+0000","last_unstale":"2024-09-17T09:11:59.135658+0000","last_undegraded":"2024-09-17T09:11:59.135658+0000","last_fullsized":"2024-09-17T09:11:59.135658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:53.774019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249445+0000","last_change":"2024-09-17T09:11:56.126392+0000","last_active":"2024-09-17T09:11:59.249445+0000","last_peered":"2024-09-17T09:11:59.249445+0000","last_clean":"2024-09-17T09:11:59.249445+0000","last_became_active":"2024-09-17T09:11:56.126061+0000","last_became_peered":"2024-09-17T09:11:56.126061+0000","last_unstale":"2024-09-17T09:11:59.249445+0000","last_undegraded":"2024-09-17T09:11:59.249445+0000","last_fullsized":"2024-09-17T09:11:59.249445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:09.085211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648238+0000","last_change":"2024-09-17T09:11:58.149032+0000","last_active":"2024-09-17T09:12:01.648238+0000","last_peered":"2024-09-17T09:12:01.648238+0000","last_clean":"2024-09-17T09:12:01.648238+0000","last_became_active":"2024-09-17T09:11:58.148157+0000","last_became_peered":"2024-09-17T09:11:58.148157+0000","last_unstale":"2024-09-17T09:12:01.648238+0000","last_undegraded":"2024-09-17T09:12:01.648238+0000","last_fullsized":"2024-09-17T09:12:01.648238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:16.315701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"31'10","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.451087+0000","last_change":"2024-09-17T09:11:54.117676+0000","last_active":"2024-09-17T09:11:59.451087+0000","last_peered":"2024-09-17T09:11:59.451087+0000","last_clean":"2024-09-17T09:11:59.451087+0000","last_became_active":"2024-09-17T09:11:54.117326+0000","last_became_peered":"2024-09-17T09:11:54.117326+0000","last_unstale":"2024-09-17T09:11:59.451087+0000","last_undegraded":"2024-09-17T09:11:59.451087+0000","last_fullsized":"2024-09-17T09:11:59.451087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:26:44.258801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136152+0000","last_change":"2024-09-17T09:11:52.107962+0000","last_active":"2024-09-17T09:11:59.136152+0000","last_peered":"2024-09-17T09:11:59.136152+0000","last_clean":"2024-09-17T09:11:59.136152+0000","last_became_active":"2024-09-17T09:11:52.107689+0000","last_became_peered":"2024-09-17T09:11:52.107689+0000","last_unstale":"2024-09-17T09:11:59.136152+0000","last_undegraded":"2024-09-17T09:11:59.136152+0000","last_fullsized":"2024-09-17T09:11:59.136152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:01.408925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136584+0000","last_change":"2024-09-17T09:11:56.127377+0000","last_active":"2024-09-17T09:11:59.136584+0000","last_peered":"2024-09-17T09:11:59.136584+0000","last_clean":"2024-09-17T09:11:59.136584+0000","last_became_active":"2024-09-17T09:11:56.126146+0000","last_became_peered":"2024-09-17T09:11:56.126146+0000","last_unstale":"2024-09-17T09:11:59.136584+0000","last_undegraded":"2024-09-17T09:11:59.136584+0000","last_fullsized":"2024-09-17T09:11:59.136584+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:13.833773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:12:01.648228+0000","last_change":"2024-09-17T09:11:58.148873+0000","last_active":"2024-09-17T09:12:01.648228+0000","last_peered":"2024-09-17T09:12:01.648228+0000","last_clean":"2024-09-17T09:12:01.648228+0000","last_became_active":"2024-09-17T09:11:58.148457+0000","last_became_peered":"2024-09-17T09:11:58.148457+0000","last_unstale":"2024-09-17T09:12:01.648228+0000","last_undegraded":"2024-09-17T09:12:01.648228+0000","last_fullsized":"2024-09-17T09:12:01.648228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:11:19.392318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"31'6","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.434020+0000","last_change":"2024-09-17T09:11:54.115466+0000","last_active":"2024-09-17T09:11:59.434020+0000","last_peered":"2024-09-17T09:11:59.434020+0000","last_clean":"2024-09-17T09:11:59.434020+0000","last_became_active":"2024-09-17T09:11:54.115161+0000","last_became_peered":"2024-09-17T09:11:54.115161+0000","last_unstale":"2024-09-17T09:11:59.434020+0000","last_undegraded":"2024-09-17T09:11:59.434020+0000","last_fullsized":"2024-09-17T09:11:59.434020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:07:54.826694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136404+0000","last_change":"2024-09-17T09:11:52.107017+0000","last_active":"2024-09-17T09:11:59.136404+0000","last_peered":"2024-09-17T09:11:59.136404+0000","last_clean":"2024-09-17T09:11:59.136404+0000","last_became_active":"2024-09-17T09:11:52.106591+0000","last_became_peered":"2024-09-17T09:11:52.106591+0000","last_unstale":"2024-09-17T09:11:59.136404+0000","last_undegraded":"2024-09-17T09:11:59.136404+0000","last_fullsized":"2024-09-17T09:11:59.136404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:45.283634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249286+0000","last_change":"2024-09-17T09:11:56.128329+0000","last_active":"2024-09-17T09:11:59.249286+0000","last_peered":"2024-09-17T09:11:59.249286+0000","last_clean":"2024-09-17T09:11:59.249286+0000","last_became_active":"2024-09-17T09:11:56.127586+0000","last_became_peered":"2024-09-17T09:11:56.127586+0000","last_unstale":"2024-09-17T09:11:59.249286+0000","last_undegraded":"2024-09-17T09:11:59.249286+0000","last_fullsized":"2024-09-17T09:11:59.249286+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:15:29.758474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134828+0000","last_change":"2024-09-17T09:11:58.143009+0000","last_active":"2024-09-17T09:11:59.134828+0000","last_peered":"2024-09-17T09:11:59.134828+0000","last_clean":"2024-09-17T09:11:59.134828+0000","last_became_active":"2024-09-17T09:11:58.142531+0000","last_became_peered":"2024-09-17T09:11:58.142531+0000","last_unstale":"2024-09-17T09:11:59.134828+0000","last_undegraded":"2024-09-17T09:11:59.134828+0000","last_fullsized":"2024-09-17T09:11:59.134828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:32.922780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.311636+0000","last_change":"2024-09-17T09:11:54.117650+0000","last_active":"2024-09-17T09:11:59.311636+0000","last_peered":"2024-09-17T09:11:59.311636+0000","last_clean":"2024-09-17T09:11:59.311636+0000","last_became_active":"2024-09-17T09:11:54.117303+0000","last_became_peered":"2024-09-17T09:11:54.117303+0000","last_unstale":"2024-09-17T09:11:59.311636+0000","last_undegraded":"2024-09-17T09:11:59.311636+0000","last_fullsized":"2024-09-17T09:11:59.311636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:53.740029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136515+0000","last_change":"2024-09-17T09:11:52.109205+0000","last_active":"2024-09-17T09:11:59.136515+0000","last_peered":"2024-09-17T09:11:59.136515+0000","last_clean":"2024-09-17T09:11:59.136515+0000","last_became_active":"2024-09-17T09:11:52.108337+0000","last_became_peered":"2024-09-17T09:11:52.108337+0000","last_unstale":"2024-09-17T09:11:59.136515+0000","last_undegraded":"2024-09-17T09:11:59.136515+0000","last_fullsized":"2024-09-17T09:11:59.136515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:39.302666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249380+0000","last_change":"2024-09-17T09:11:56.127088+0000","last_active":"2024-09-17T09:11:59.249380+0000","last_peered":"2024-09-17T09:11:59.249380+0000","last_clean":"2024-09-17T09:11:59.249380+0000","last_became_active":"2024-09-17T09:11:56.126760+0000","last_became_peered":"2024-09-17T09:11:56.126760+0000","last_unstale":"2024-09-17T09:11:59.249380+0000","last_undegraded":"2024-09-17T09:11:59.249380+0000","last_fullsized":"2024-09-17T09:11:59.249380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:12.851678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134799+0000","last_change":"2024-09-17T09:11:58.145003+0000","last_active":"2024-09-17T09:11:59.134799+0000","last_peered":"2024-09-17T09:11:59.134799+0000","last_clean":"2024-09-17T09:11:59.134799+0000","last_became_active":"2024-09-17T09:11:58.144637+0000","last_became_peered":"2024-09-17T09:11:58.144637+0000","last_unstale":"2024-09-17T09:11:59.134799+0000","last_undegraded":"2024-09-17T09:11:59.134799+0000","last_fullsized":"2024-09-17T09:11:59.134799+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T20:11:53.006286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136082+0000","last_change":"2024-09-17T09:11:58.143366+0000","last_active":"2024-09-17T09:11:59.136082+0000","last_peered":"2024-09-17T09:11:59.136082+0000","last_clean":"2024-09-17T09:11:59.136082+0000","last_became_active":"2024-09-17T09:11:58.142954+0000","last_became_peered":"2024-09-17T09:11:58.142954+0000","last_unstale":"2024-09-17T09:11:59.136082+0000","last_undegraded":"2024-09-17T09:11:59.136082+0000","last_fullsized":"2024-09-17T09:11:59.136082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:57.891313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"31'15","reported_seq":41,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.477146+0000","last_change":"2024-09-17T09:11:54.116798+0000","last_active":"2024-09-17T09:11:59.477146+0000","last_peered":"2024-09-17T09:11:59.477146+0000","last_clean":"2024-09-17T09:11:59.477146+0000","last_became_active":"2024-09-17T09:11:54.115289+0000","last_became_peered":"2024-09-17T09:11:54.115289+0000","last_unstale":"2024-09-17T09:11:59.477146+0000","last_undegraded":"2024-09-17T09:11:59.477146+0000","last_fullsized":"2024-09-17T09:11:59.477146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:36:02.718609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135146+0000","last_change":"2024-09-17T09:11:52.108876+0000","last_active":"2024-09-17T09:11:59.135146+0000","last_peered":"2024-09-17T09:11:59.135146+0000","last_clean":"2024-09-17T09:11:59.135146+0000","last_became_active":"2024-09-17T09:11:52.108159+0000","last_became_peered":"2024-09-17T09:11:52.108159+0000","last_unstale":"2024-09-17T09:11:59.135146+0000","last_undegraded":"2024-09-17T09:11:59.135146+0000","last_fullsized":"2024-09-17T09:11:59.135146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:43:48.868581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249757+0000","last_change":"2024-09-17T09:11:56.127036+0000","last_active":"2024-09-17T09:11:59.249757+0000","last_peered":"2024-09-17T09:11:59.249757+0000","last_clean":"2024-09-17T09:11:59.249757+0000","last_became_active":"2024-09-17T09:11:56.126753+0000","last_became_peered":"2024-09-17T09:11:56.126753+0000","last_unstale":"2024-09-17T09:11:59.249757+0000","last_undegraded":"2024-09-17T09:11:59.249757+0000","last_fullsized":"2024-09-17T09:11:59.249757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:28.700556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249661+0000","last_change":"2024-09-17T09:11:58.142525+0000","last_active":"2024-09-17T09:11:59.249661+0000","last_peered":"2024-09-17T09:11:59.249661+0000","last_clean":"2024-09-17T09:11:59.249661+0000","last_became_active":"2024-09-17T09:11:58.142119+0000","last_became_peered":"2024-09-17T09:11:58.142119+0000","last_unstale":"2024-09-17T09:11:59.249661+0000","last_undegraded":"2024-09-17T09:11:59.249661+0000","last_fullsized":"2024-09-17T09:11:59.249661+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:58.029740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.283175+0000","last_change":"2024-09-17T09:11:54.116984+0000","last_active":"2024-09-17T09:11:59.283175+0000","last_peered":"2024-09-17T09:11:59.283175+0000","last_clean":"2024-09-17T09:11:59.283175+0000","last_became_active":"2024-09-17T09:11:54.116529+0000","last_became_peered":"2024-09-17T09:11:54.116529+0000","last_unstale":"2024-09-17T09:11:59.283175+0000","last_undegraded":"2024-09-17T09:11:59.283175+0000","last_fullsized":"2024-09-17T09:11:59.283175+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:17.365472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.134618+0000","last_change":"2024-09-17T09:11:52.108771+0000","last_active":"2024-09-17T09:11:59.134618+0000","last_peered":"2024-09-17T09:11:59.134618+0000","last_clean":"2024-09-17T09:11:59.134618+0000","last_became_active":"2024-09-17T09:11:52.107523+0000","last_became_peered":"2024-09-17T09:11:52.107523+0000","last_unstale":"2024-09-17T09:11:59.134618+0000","last_undegraded":"2024-09-17T09:11:59.134618+0000","last_fullsized":"2024-09-17T09:11:59.134618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T19:03:45.054200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'8","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T09:12:40.038452+0000","last_change":"2024-09-17T09:11:56.127178+0000","last_active":"2024-09-17T09:12:40.038452+0000","last_peered":"2024-09-17T09:12:40.038452+0000","last_clean":"2024-09-17T09:12:40.038452+0000","last_became_active":"2024-09-17T09:11:56.126410+0000","last_became_peered":"2024-09-17T09:11:56.126410+0000","last_unstale":"2024-09-17T09:12:40.038452+0000","last_undegraded":"2024-09-17T09:12:40.038452+0000","last_fullsized":"2024-09-17T09:12:40.038452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:17:13.874497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135200+0000","last_change":"2024-09-17T09:11:52.108343+0000","last_active":"2024-09-17T09:11:59.135200+0000","last_peered":"2024-09-17T09:11:59.135200+0000","last_clean":"2024-09-17T09:11:59.135200+0000","last_became_active":"2024-09-17T09:11:52.108058+0000","last_became_peered":"2024-09-17T09:11:52.108058+0000","last_unstale":"2024-09-17T09:11:59.135200+0000","last_undegraded":"2024-09-17T09:11:59.135200+0000","last_fullsized":"2024-09-17T09:11:59.135200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T21:04:26.165359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"31'5","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.361327+0000","last_change":"2024-09-17T09:11:54.120073+0000","last_active":"2024-09-17T09:11:59.361327+0000","last_peered":"2024-09-17T09:11:59.361327+0000","last_clean":"2024-09-17T09:11:59.361327+0000","last_became_active":"2024-09-17T09:11:54.119787+0000","last_became_peered":"2024-09-17T09:11:54.119787+0000","last_unstale":"2024-09-17T09:11:59.361327+0000","last_undegraded":"2024-09-17T09:11:59.361327+0000","last_fullsized":"2024-09-17T09:11:59.361327+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:05.897190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135857+0000","last_change":"2024-09-17T09:11:56.125748+0000","last_active":"2024-09-17T09:11:59.135857+0000","last_peered":"2024-09-17T09:11:59.135857+0000","last_clean":"2024-09-17T09:11:59.135857+0000","last_became_active":"2024-09-17T09:11:56.125494+0000","last_became_peered":"2024-09-17T09:11:56.125494+0000","last_unstale":"2024-09-17T09:11:59.135857+0000","last_undegraded":"2024-09-17T09:11:59.135857+0000","last_fullsized":"2024-09-17T09:11:59.135857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:29:28.641507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.249617+0000","last_change":"2024-09-17T09:11:58.143012+0000","last_active":"2024-09-17T09:11:59.249617+0000","last_peered":"2024-09-17T09:11:59.249617+0000","last_clean":"2024-09-17T09:11:59.249617+0000","last_became_active":"2024-09-17T09:11:58.142755+0000","last_became_peered":"2024-09-17T09:11:58.142755+0000","last_unstale":"2024-09-17T09:11:59.249617+0000","last_undegraded":"2024-09-17T09:11:59.249617+0000","last_fullsized":"2024-09-17T09:11:59.249617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:48:45.367728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.135575+0000","last_change":"2024-09-17T09:11:52.107923+0000","last_active":"2024-09-17T09:11:59.135575+0000","last_peered":"2024-09-17T09:11:59.135575+0000","last_clean":"2024-09-17T09:11:59.135575+0000","last_became_active":"2024-09-17T09:11:52.107554+0000","last_became_peered":"2024-09-17T09:11:52.107554+0000","last_unstale":"2024-09-17T09:11:59.135575+0000","last_undegraded":"2024-09-17T09:11:59.135575+0000","last_fullsized":"2024-09-17T09:11:59.135575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:51.095294+0000","last_clean_scrub_stamp":"2024-09-17T09:11:51.095294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:12.378703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"31'9","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.382039+0000","last_change":"2024-09-17T09:11:54.119391+0000","last_active":"2024-09-17T09:11:59.382039+0000","last_peered":"2024-09-17T09:11:59.382039+0000","last_clean":"2024-09-17T09:11:59.382039+0000","last_became_active":"2024-09-17T09:11:54.119108+0000","last_became_peered":"2024-09-17T09:11:54.119108+0000","last_unstale":"2024-09-17T09:11:59.382039+0000","last_undegraded":"2024-09-17T09:11:59.382039+0000","last_fullsized":"2024-09-17T09:11:59.382039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:53.099209+0000","last_clean_scrub_stamp":"2024-09-17T09:11:53.099209+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:44.613781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.136727+0000","last_change":"2024-09-17T09:11:56.125765+0000","last_active":"2024-09-17T09:11:59.136727+0000","last_peered":"2024-09-17T09:11:59.136727+0000","last_clean":"2024-09-17T09:11:59.136727+0000","last_became_active":"2024-09-17T09:11:56.125482+0000","last_became_peered":"2024-09-17T09:11:56.125482+0000","last_unstale":"2024-09-17T09:11:59.136727+0000","last_undegraded":"2024-09-17T09:11:59.136727+0000","last_fullsized":"2024-09-17T09:11:59.136727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:55.108435+0000","last_clean_scrub_stamp":"2024-09-17T09:11:55.108435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:33:53.975700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T09:11:59.282130+0000","last_change":"2024-09-17T09:11:58.142723+0000","last_active":"2024-09-17T09:11:59.282130+0000","last_peered":"2024-09-17T09:11:59.282130+0000","last_clean":"2024-09-17T09:11:59.282130+0000","last_became_active":"2024-09-17T09:11:58.142395+0000","last_became_peered":"2024-09-17T09:11:58.142395+0000","last_unstale":"2024-09-17T09:11:59.282130+0000","last_undegraded":"2024-09-17T09:11:59.282130+0000","last_fullsized":"2024-09-17T09:11:59.282130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T09:11:57.124357+0000","last_clean_scrub_stamp":"2024-09-17T09:11:57.124357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:28.773716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":177,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":391,"ondisk_log_size":391,"up":96,"acting":96,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1386,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":96,"acting":96,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":252,"num_read_kb":342,"num_write":267,"num_write_kb":4504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":18,"seq":77309411343,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":32144,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93708912,"statfs":{"total":95990841344,"available":95957925888,"internally_reserved":0,"allocated":1052672,"data_stored":703028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 09:12:41 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.46100000000000002}]},{"osd":1,"last update":"Tue Sep 17 09:12:41 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.35599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":32144,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93708912,"statfs":{"total":95990841344,"available":95957925888,"internally_reserved":0,"allocated":1052672,"data_stored":703028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Sep 17 09:12:15 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32100000000000001}]},{"osd":2,"last update":"Tue Sep 17 09:12:39 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.371},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":129,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93741056,"kb_used":36240,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93704816,"statfs":{"total":95990841344,"available":95953731584,"internally_reserved":0,"allocated":1052672,"data_stored":703028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Sep 17 09:12:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.311}]},{"osd":2,"last update":"Tue Sep 17 09:12:37 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.41699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":3702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":3702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":3702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T09:12:51.708 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-17T09:12:51.708 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T09:12:51.708 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-17T09:12:51.709 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-17T09:12:51.912 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:51.974 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:12:51 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a[46472]: ts=2024-09-17T09:12:51.879Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002279918s 2024-09-17T09:12:52.277 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:52 smithi161 ceph-mon[27677]: pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:52.278 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:52 smithi161 ceph-mon[27677]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:12:52.321 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:52 smithi042 ceph-mon[25899]: pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:52.325 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:52 smithi042 ceph-mon[25899]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:12:52.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:52 smithi179 ceph-mon[27782]: pgmap v18: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:52.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:52 smithi179 ceph-mon[27782]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-17T09:12:52.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:12:52 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ::ffff:172.21.15.161 - - [17/Sep/2024:09:12:52] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:12:53.748 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-09-17T09:12:53.748 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T09:12:54.348 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:54 smithi042 ceph-mon[25899]: pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:54.349 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:54 smithi042 ceph-mon[25899]: from='client.? 172.21.15.42:0/3255853605' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T09:12:54.373 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-17T09:12:54.373 INFO:tasks.cephadm:Setup complete, yielding 2024-09-17T09:12:54.373 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-17T09:12:54.383 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T09:12:54.384 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'stat -c '"'"'%u %g'"'"' /var/log/ceph | grep '"'"'167 167'"'"'' 2024-09-17T09:12:54.385 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-mon[27677]: pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:54.385 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-mon[27677]: from='client.? 172.21.15.42:0/3255853605' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T09:12:54.385 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.371300987Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-09-17T09:12:54.385 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.3740153Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-09-17T09:12:54.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:54 smithi179 ceph-mon[27782]: pgmap v19: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:54.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:54 smithi179 ceph-mon[27782]: from='client.? 172.21.15.42:0/3255853605' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-17T09:12:54.597 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:54.626 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.376776156Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-09-17T09:12:54.626 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.379447056Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-09-17T09:12:54.626 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.38218487Z level=info msg="Executing migration" id="create temp_user v2" 2024-09-17T09:12:54.626 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.384865462Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-09-17T09:12:54.626 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.387526242Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-09-17T09:12:54.626 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.390746616Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.392870183Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.393686326Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.394515046Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.395405272Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.396153391Z level=info msg="Executing migration" id="create star table" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.396538634Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.397325204Z level=info msg="Executing migration" id="create org table v1" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.398158257Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.399006056Z level=info msg="Executing migration" id="create org_user table v1" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.39983808Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.400652469Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.401437171Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-09-17T09:12:54.627 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.401829616Z level=info msg="Executing migration" id="Update org table charset" 2024-09-17T09:12:54.628 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.402649388Z level=info msg="Executing migration" id="Update org_user table charset" 2024-09-17T09:12:54.628 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.403497352Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-09-17T09:12:54.628 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.404349456Z level=info msg="Executing migration" id="create dashboard table" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.404747827Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.405514785Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.406370808Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.407247807Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.407660599Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.408498896Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.409357116Z level=info msg="Executing migration" id="create dashboard v2" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.410198001Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.41061137Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.411486504Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.412328686Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-09-17T09:12:54.629 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.413177263Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.413479447Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.414299326Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.415146181Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.415991726Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.416405344Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.417276736Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.418099089Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.418980267Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.419275422Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.422034916Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.422534324Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.424900788Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-09-17T09:12:54.630 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.427639372Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.428137854Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.430815015Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.433713747Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.436521131Z level=info msg="Executing migration" id="Update dashboard title length" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.43682031Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.439433143Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.442203289Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.444920867Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.44531752Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.44807741Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.450687961Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-09-17T09:12:54.631 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.453429125Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.453796449Z level=info msg="Executing migration" id="Add check_sum column" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.45660339Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.459336516Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.461974488Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.462301488Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.465011098Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.467567562Z level=info msg="Executing migration" id="create data_source table" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.470229129Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.470655485Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.47327784Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.475971266Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-09-17T09:12:54.632 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.478888155Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.479928101Z level=info msg="Executing migration" id="create data_source table v2" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.482505026Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.485056137Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.487627823Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.488006455Z level=info msg="Executing migration" id="Add column with_credentials" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.490515455Z level=info msg="Executing migration" id="Add secure json data column" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.493193546Z level=info msg="Executing migration" id="Update data_source table charset" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.495821333Z level=info msg="Executing migration" id="Update initial version to 1" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.49621534Z level=info msg="Executing migration" id="Add read_only data column" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.498769155Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.499122886Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.499649098Z level=info msg="Executing migration" id="Add uid column" 2024-09-17T09:12:54.633 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.500215746Z level=info msg="Executing migration" id="Update uid value" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.500530717Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.501021639Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.501493826Z level=info msg="Executing migration" id="create api_key table" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.502333411Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.503150134Z level=info msg="Executing migration" id="add index api_key.key" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.503969105Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.504429486Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.505253129Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.505732952Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.506166342Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.507217671Z level=info msg="Executing migration" id="create api_key table v2" 2024-09-17T09:12:54.634 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.508033806Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-09-17T09:12:54.635 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.508460979Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.508883669Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.509314194Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.509626408Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.509988319Z level=info msg="Executing migration" id="Update api_key table charset" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.510279319Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.510795728Z level=info msg="Executing migration" id="Add service account foreign key" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.511341479Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.511640238Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.5121996Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.512756019Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-09-17T09:12:54.636 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.513151281Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.513504399Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.513924939Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.514359947Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.514788081Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.515226223Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.515570574Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.51588613Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.516453892Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.517146443Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.518174674Z level=info msg="Executing migration" id="create quota table v1" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.518761915Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.519340803Z level=info msg="Executing migration" id="Update quota table charset" 2024-09-17T09:12:54.637 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.519688272Z level=info msg="Executing migration" id="create plugin_setting table" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.520111263Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.520542134Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.521142376Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.521454142Z level=info msg="Executing migration" id="create session table" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.52194075Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.522309603Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.522595554Z level=info msg="Executing migration" id="create playlist table v2" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.523005967Z level=info msg="Executing migration" id="create playlist item table v2" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.523412223Z level=info msg="Executing migration" id="Update playlist table charset" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.523678966Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.523982735Z level=info msg="Executing migration" id="drop preferences table v2" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.524271444Z level=info msg="Executing migration" id="drop preferences table v3" 2024-09-17T09:12:54.638 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.524558164Z level=info msg="Executing migration" id="create preferences table v3" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.524962577Z level=info msg="Executing migration" id="Update preferences table charset" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.525263556Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.525884013Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.526208984Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.5267843Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.527373473Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.527650222Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.528115893Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.528596029Z level=info msg="Executing migration" id="create alert table v1" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.52943873Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.530228931Z level=info msg="Executing migration" id="add index alert state" 2024-09-17T09:12:54.639 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.530979941Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.531412633Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.531793761Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.532225721Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.532614744Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.534045439Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.534433441Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.535255216Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.535586594Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.535961712Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.536352871Z level=info msg="Executing migration" id="Add column is_default" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.536984052Z level=info msg="Executing migration" id="Add column frequency" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.537607633Z level=info msg="Executing migration" id="Add column send_reminder" 2024-09-17T09:12:54.640 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.538307451Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.538983107Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.539436911Z level=info msg="Executing migration" id="Update alert table charset" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.539749Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.540056257Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.540471896Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.540931123Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.541349999Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.542167022Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.542649813Z level=info msg="Executing migration" id="Add for to alert table" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.543307595Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.544192026Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-09-17T09:12:54.641 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.545046951Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.545905584Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.546791023Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.547687669Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.548557481Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.549452328Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.550304271Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.5511564Z level=info msg="Executing migration" id="create annotation table v5" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.552035399Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.552902318Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.553796584Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.556740952Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.55963333Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-09-17T09:12:54.642 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.562445323Z level=info msg="Executing migration" id="Update annotation table charset" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.565278541Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.568172507Z level=info msg="Executing migration" id="Drop category_id index" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.570984332Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.573793606Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.576609381Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.579342275Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.582166141Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.58502125Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.587892036Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.590567791Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.593268178Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.596191177Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-09-17T09:12:54.643 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.599142359Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.601893625Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.604510391Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.607098816Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.609815406Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.612582064Z level=info msg="Executing migration" id="Add epoch_end column" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.615284555Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.617902801Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.62051016Z level=info msg="Executing migration" id="Move region to single row" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.623263987Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.625856649Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.628667706Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.631242304Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-09-17T09:12:54.644 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.631885425Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-09-17T09:12:54.877 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.634323935Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-09-17T09:12:54.877 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.636965397Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-09-17T09:12:54.877 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.639629253Z level=info msg="Executing migration" id="create test_data table" 2024-09-17T09:12:54.877 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.640134667Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-09-17T09:12:54.877 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.640644732Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-09-17T09:12:54.877 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.644040572Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-09-17T09:12:54.877 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.646073119Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.646436267Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.647216409Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.647540985Z level=info msg="Executing migration" id="create team table" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.64812401Z level=info msg="Executing migration" id="add index team.org_id" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.648946825Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.649415488Z level=info msg="Executing migration" id="create team member table" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.65023969Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.65111702Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.651900029Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.652677671Z level=info msg="Executing migration" id="Add column email to team table" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.653485852Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-09-17T09:12:54.878 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.654300746Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-09-17T09:12:54.879 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.655088029Z level=info msg="Executing migration" id="create dashboard acl table" 2024-09-17T09:12:54.879 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.655510282Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-09-17T09:12:54.879 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.656385777Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-09-17T09:12:54.879 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.657188307Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.658017963Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.658524162Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.659375469Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.660262358Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.66151515Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.662050471Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.662893729Z level=info msg="Executing migration" id="create tag table" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.663755546Z level=info msg="Executing migration" id="add index tag.key_value" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.66462637Z level=info msg="Executing migration" id="create login attempt table" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.665476708Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.666338676Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.667113834Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-09-17T09:12:54.880 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.669028375Z level=info msg="Executing migration" id="create login_attempt v2" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.669892636Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.670776415Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.67158554Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.6724044Z level=info msg="Executing migration" id="create user auth table" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.674496425Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.675357214Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.678199699Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.680983649Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.683779638Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.686474564Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.689511183Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.692078534Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.694954006Z level=info msg="Executing migration" id="create server_lock table" 2024-09-17T09:12:54.881 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.697601666Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.700518754Z level=info msg="Executing migration" id="create user auth token table" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.703272741Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.705887711Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.708809823Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.711513666Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.714384476Z level=info msg="Executing migration" id="create cache_data table" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.716888029Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.719833998Z level=info msg="Executing migration" id="create short_url table v1" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.722803271Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.725331946Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-09-17T09:12:54.882 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.728232729Z level=info msg="Executing migration" id="delete alert_definition table" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.730907348Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.733647626Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.736356822Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.738941853Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.741624778Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.744508228Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.747123495Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.749751693Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.75231335Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.755188167Z level=info msg="Executing migration" id="drop alert_definition table" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.757920376Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.760655198Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-09-17T09:12:54.883 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.76338929Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.766005405Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.768632929Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.771355262Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.772170678Z level=info msg="Executing migration" id="create alert_instance table" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.772917991Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.773772893Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.774582474Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.775399767Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.776206863Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.777047897Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.780604704Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.784170107Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.78500565Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-09-17T09:12:54.884 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.78582507Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-09-17T09:12:54.885 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.786647364Z level=info msg="Executing migration" id="create alert_rule table" 2024-09-17T09:12:54.885 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.787485996Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-09-17T09:12:54.885 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.788305482Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-09-17T09:12:54.885 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.789181762Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-09-17T09:12:54.885 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.789971072Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-09-17T09:12:54.885 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.790813563Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.791662716Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.792548629Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.793439984Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.794312646Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.795162073Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.79598558Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.796836425Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.797699073Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.798586311Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.799426972Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.800297886Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.801147098Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.801973913Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-09-17T09:12:54.886 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.802857222Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.803704507Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.8046331Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.805516202Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.80641728Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.809336173Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.81207362Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.815043447Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.817811024Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.820618792Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.823354111Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.826333304Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-09-17T09:12:54.887 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.829168954Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.831960881Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.834764469Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.837403836Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.840188429Z level=info msg="Executing migration" id="create provenance_type table" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.84302363Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.845935574Z level=info msg="Executing migration" id="create alert_image table" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.848751915Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.851350982Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.85416324Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.856882092Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.859562473Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.859648586Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.862341956Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-09-17T09:12:54.888 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.865115038Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.867774339Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.867910856Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.868036314Z level=info msg="alerts found to migrate" alerts=0 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.870402182Z level=info msg="Executing migration" id="create library_element table v1" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.872948331Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.873493524Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.874350416Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.875210398Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.87611013Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.876836623Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.877663452Z level=info msg="Executing migration" id="create data_keys table" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.878530893Z level=info msg="Executing migration" id="create secrets table" 2024-09-17T09:12:54.889 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.879408058Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-09-17T09:12:55.143 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.883750667Z level=info msg="Executing migration" id="add name column into data_keys" 2024-09-17T09:12:55.143 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.884669642Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.885554741Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.889945902Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.897983115Z level=info msg="Executing migration" id="create kv_store table v1" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.898793175Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.899436853Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.899936919Z level=info msg="Executing migration" id="create permission table" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.90052273Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.901137044Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.901773738Z level=info msg="Executing migration" id="create role table" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.902380926Z level=info msg="Executing migration" id="add column display_name" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.903845976Z level=info msg="Executing migration" id="add column group_name" 2024-09-17T09:12:55.144 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.905360247Z level=info msg="Executing migration" id="add index role.org_id" 2024-09-17T09:12:55.145 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.905997112Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-09-17T09:12:55.145 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.906618393Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-09-17T09:12:55.145 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.907234213Z level=info msg="Executing migration" id="create team role table" 2024-09-17T09:12:55.145 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.907802912Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-09-17T09:12:55.145 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.908451344Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.909109576Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.909701408Z level=info msg="Executing migration" id="create user role table" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.910305841Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.910905913Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.911546594Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.912196131Z level=info msg="Executing migration" id="create builtin role table" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.912821959Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.913614514Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.914360635Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-09-17T09:12:55.146 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.915920854Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.916613022Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.917432055Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.918052434Z level=info msg="Executing migration" id="add unique index role.uid" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.91868644Z level=info msg="Executing migration" id="create seed assignment table" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.919304105Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.919966287Z level=info msg="Executing migration" id="add column hidden to role table" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.921615865Z level=info msg="Executing migration" id="create query_history table v1" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.9222516Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.922903364Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.923347695Z level=info msg="Executing migration" id="teams permissions migration" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.923949323Z level=info msg="Executing migration" id="dashboard permissions" 2024-09-17T09:12:55.147 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.924653154Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.925242849Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.925645181Z level=info msg="Executing migration" id="alerting notification permissions" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.926195615Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.926786119Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.927443565Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.929022565Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.929457334Z level=info msg="Executing migration" id="create correlation table v1" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.930047955Z level=info msg="Executing migration" id="add index correlations.uid" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.930655502Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-09-17T09:12:55.148 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.931271631Z level=info msg="Executing migration" id="add correlation config column" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.932836979Z level=info msg="Executing migration" id="create entity_events table" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.933441169Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.934233949Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.9343302Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.934628075Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.934710844Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.935010422Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.935867781Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.936752268Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.937669286Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.938529804Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-09-17T09:12:55.149 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.939404351Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.940319566Z level=info msg="Executing migration" id="Drop public config table" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.941333902Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.942009807Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.942900121Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.943759833Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.946694261Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.94996795Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.952935814Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.95568463Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.958565479Z level=info msg="Executing migration" id="add share column" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.961384046Z level=info msg="Executing migration" id="create default alerting folders" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.964177546Z level=info msg="Executing migration" id="create file table" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.966903442Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-09-17T09:12:55.150 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.969609795Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.972415187Z level=info msg="Executing migration" id="create file_meta table" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.972899636Z level=info msg="Executing migration" id="file table idx: path key" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.975784073Z level=info msg="Executing migration" id="set path collation in file table" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.978685694Z level=info msg="Executing migration" id="managed permissions migration" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.981359451Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.984238873Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.98697529Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.989975972Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.992753475Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.995455969Z level=info msg="Executing migration" id="update group index for alert rules" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:54 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:54.9978778Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.000746895Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.003511401Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-09-17T09:12:55.151 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.005992882Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.0087732Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.011177835Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.021016699Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.023653735Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.02629758Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.029939828Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.032701183Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.035331586Z level=info msg="Executing migration" id="create folder table" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.03789333Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.040601318Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.043181176Z level=info msg="Executing migration" id="Update folder title length" 2024-09-17T09:12:55.152 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.046028809Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-09-17T09:12:55.153 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=migrator t=2024-09-17T09:12:55.048567835Z level=info msg="migrations completed" performed=485 skipped=0 duration=743.048706ms 2024-09-17T09:12:55.153 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=sqlstore t=2024-09-17T09:12:55.049044077Z level=info msg="Created default organization" 2024-09-17T09:12:55.153 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=plugin.loader t=2024-09-17T09:12:55.106910971Z level=info msg="Plugin registered" pluginID=input 2024-09-17T09:12:55.153 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=plugin.loader t=2024-09-17T09:12:55.142977201Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-09-17T09:12:55.153 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=plugin.loader t=2024-09-17T09:12:55.143036725Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-09-17T09:12:55.153 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=secrets t=2024-09-17T09:12:55.143110733Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-09-17T09:12:55.153 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=query_data t=2024-09-17T09:12:55.145333784Z level=info msg="Query Service initialization" 2024-09-17T09:12:55.296 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:55 smithi042 systemd[1]: Starting Ceph node-exporter.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:12:55.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-mon[27677]: Deploying daemon node-exporter.a on smithi042 2024-09-17T09:12:55.519 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=live.push_http t=2024-09-17T09:12:55.148409699Z level=info msg="Live Push Gateway initialization" 2024-09-17T09:12:55.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:55 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:55 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:55 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:55 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:55 smithi042 ceph-mon[25899]: Deploying daemon node-exporter.a on smithi042 2024-09-17T09:12:55.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:55 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:55 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:55 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:55 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:55.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:55 smithi179 ceph-mon[27782]: Deploying daemon node-exporter.a on smithi042 2024-09-17T09:12:56.268 INFO:teuthology.orchestra.run.smithi042.stdout:167 167 2024-09-17T09:12:56.268 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=infra.usagestats.collector t=2024-09-17T09:12:55.918508853Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-09-17T09:12:56.268 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:55 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=provisioning.datasources t=2024-09-17T09:12:55.972999549Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=provisioning.datasources t=2024-09-17T09:12:56.004696343Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=provisioning.alerting t=2024-09-17T09:12:56.026273177Z level=info msg="starting to provision alerting" 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=provisioning.alerting t=2024-09-17T09:12:56.026292877Z level=info msg="finished to provision alerting" 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=grafanaStorageLogger t=2024-09-17T09:12:56.026371625Z level=info msg="storage starting" 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=ngalert.state.manager t=2024-09-17T09:12:56.026493763Z level=info msg="Warming state cache for startup" 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=http.server t=2024-09-17T09:12:56.03199584Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=ngalert.state.manager t=2024-09-17T09:12:56.036946516Z level=info msg="State cache has been initialized" states=0 duration=10.448485ms 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=ngalert.multiorg.alertmanager t=2024-09-17T09:12:56.037012753Z level=info msg="starting MultiOrg Alertmanager" 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=ticker t=2024-09-17T09:12:56.037037954Z level=info msg=starting first_tick=2024-09-17T09:13:00Z 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=sqlstore.transactions t=2024-09-17T09:12:56.03711573Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-17T09:12:56.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=sqlstore.transactions t=2024-09-17T09:12:56.080071539Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-17T09:12:56.270 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=sqlstore.transactions t=2024-09-17T09:12:56.090411885Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-09-17T09:12:56.270 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a[38020]: logger=sqlstore.transactions t=2024-09-17T09:12:56.129870827Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-09-17T09:12:56.311 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:56 smithi042 bash[48183]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-17T09:12:56.589 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:56 smithi042 ceph-mon[25899]: pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:56.589 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:56 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:56.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-mon[27677]: pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:56.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:56 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:56.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:56 smithi179 ceph-mon[27782]: pgmap v20: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:56.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:56 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:12:56.932 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:56 smithi042 bash[48183]: Getting image source signatures 2024-09-17T09:12:56.932 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:56 smithi042 bash[48183]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-17T09:12:56.932 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:56 smithi042 bash[48183]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-17T09:12:56.932 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:56 smithi042 bash[48183]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-17T09:12:56.953 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-17T09:12:57.175 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:12:58.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:12:58 smithi042 ceph-mon[25899]: pgmap v21: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:58.475 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:58 smithi042 bash[48183]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-17T09:12:58.576 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:12:58 smithi161 ceph-mon[27677]: pgmap v21: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:58.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:12:58 smithi179 ceph-mon[27782]: pgmap v21: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:12:58.873 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:58 smithi042 bash[48183]: Writing manifest to image destination 2024-09-17T09:12:59.150 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:58 smithi042 podman[48183]: 2024-09-17 09:12:58.810014657 +0000 UTC m=+2.736521973 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-17T09:12:59.722 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 podman[48183]: 2024-09-17 09:12:59.561523219 +0000 UTC m=+3.488030564 container create 934ead8d53cf075e2ffff1477d0c496b82fba6c861768affe13f3c3a9c036cf9 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 podman[48183]: 2024-09-17 09:12:59.939698044 +0000 UTC m=+3.866205359 container init 934ead8d53cf075e2ffff1477d0c496b82fba6c861768affe13f3c3a9c036cf9 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 podman[48183]: 2024-09-17 09:12:59.944956426 +0000 UTC m=+3.871463730 container start 934ead8d53cf075e2ffff1477d0c496b82fba6c861768affe13f3c3a9c036cf9 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.948Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.949Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.949Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.949Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.949Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.949Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-17T09:12:59.975 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=arp 2024-09-17T09:12:59.976 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-17T09:12:59.976 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-17T09:12:59.976 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-17T09:12:59.976 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-17T09:12:59.976 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-17T09:12:59.976 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=edac 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-17T09:12:59.977 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=os 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-17T09:12:59.978 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=stat 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=time 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=uname 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-17T09:12:59.979 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-17T09:12:59.980 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-17T09:12:59.980 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-17T09:12:59.980 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:12:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a[48445]: ts=2024-09-17T09:12:59.950Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-17T09:13:00.006 INFO:teuthology.orchestra.run.smithi042.stdout:Backend: cephadm 2024-09-17T09:13:00.006 INFO:teuthology.orchestra.run.smithi042.stdout:Available: Yes 2024-09-17T09:13:00.006 INFO:teuthology.orchestra.run.smithi042.stdout:Paused: No 2024-09-17T09:13:00.316 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:13:00 smithi042 bash[48183]: 934ead8d53cf075e2ffff1477d0c496b82fba6c861768affe13f3c3a9c036cf9 2024-09-17T09:13:00.317 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:13:00 smithi042 systemd[1]: Started Ceph node-exporter.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:13:00.494 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:00 smithi161 ceph-mon[27677]: pgmap v22: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:00.494 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:00 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.494 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:00 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.494 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:00 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.619 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:00 smithi042 ceph-mon[25899]: pgmap v22: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:00.619 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:00 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.619 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:00 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.619 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:00 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-17T09:13:00.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:00 smithi179 ceph-mon[27782]: pgmap v22: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:00.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:00 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:00 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:00 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:00.842 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:13:01.650 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:01 smithi179 ceph-mon[27782]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:01.651 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:01 smithi179 ceph-mon[27782]: Deploying daemon node-exporter.b on smithi161 2024-09-17T09:13:01.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:01 smithi042 ceph-mon[25899]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:01.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:01 smithi042 ceph-mon[25899]: Deploying daemon node-exporter.b on smithi161 2024-09-17T09:13:01.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:01 smithi161 ceph-mon[27677]: from='client.14529 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:01.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:01 smithi161 ceph-mon[27677]: Deploying daemon node-exporter.b on smithi161 2024-09-17T09:13:02.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:02 smithi042 ceph-mon[25899]: pgmap v23: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:02.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:02 smithi161 ceph-mon[27677]: pgmap v23: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:02.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:02 smithi179 ceph-mon[27782]: pgmap v23: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:02.861 INFO:teuthology.orchestra.run.smithi042.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-17T09:13:02.861 INFO:teuthology.orchestra.run.smithi042.stdout:agent.smithi042 smithi042 running 48s ago 3m - - 2024-09-17T09:13:02.861 INFO:teuthology.orchestra.run.smithi042.stdout:agent.smithi161 smithi161 running 57s ago 3m - - 2024-09-17T09:13:02.861 INFO:teuthology.orchestra.run.smithi042.stdout:agent.smithi179 smithi179 running 55s ago 3m - - 2024-09-17T09:13:02.862 INFO:teuthology.orchestra.run.smithi042.stdout:alertmanager.a smithi042 *:9093,9094 starting - - - - 2024-09-17T09:13:02.862 INFO:teuthology.orchestra.run.smithi042.stdout:grafana.a smithi161 *:3000 starting - - - - 2024-09-17T09:13:02.862 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.x smithi161 *:8443,8765 running (2m) 57s ago 2m 440M - 18.2.4-855-g19e2a2be 980a0bfcd684 a7b5de7a3526 2024-09-17T09:13:02.862 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.y smithi042 *:9283,8765 running (4m) 48s ago 4m 494M - 18.2.4-855-g19e2a2be 980a0bfcd684 2fc2c023ed1e 2024-09-17T09:13:02.862 INFO:teuthology.orchestra.run.smithi042.stdout:mgr.z smithi179 *:8443,8765 running (2m) 55s ago 2m 437M - 18.2.4-855-g19e2a2be 980a0bfcd684 a516ef5b2114 2024-09-17T09:13:02.863 INFO:teuthology.orchestra.run.smithi042.stdout:mon.a smithi042 running (4m) 48s ago 4m 46.6M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 01fa157211b7 2024-09-17T09:13:02.863 INFO:teuthology.orchestra.run.smithi042.stdout:mon.b smithi161 running (2m) 57s ago 2m 39.9M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 cf885518b748 2024-09-17T09:13:02.863 INFO:teuthology.orchestra.run.smithi042.stdout:mon.c smithi179 running (3m) 55s ago 3m 42.4M 2048M 18.2.4-855-g19e2a2be 980a0bfcd684 2bdf791b79e3 2024-09-17T09:13:02.863 INFO:teuthology.orchestra.run.smithi042.stdout:node-exporter.a smithi042 *:9100 starting - - - - 2024-09-17T09:13:02.863 INFO:teuthology.orchestra.run.smithi042.stdout:osd.0 smithi042 running (2m) 48s ago 2m 57.1M 4096M 18.2.4-855-g19e2a2be 980a0bfcd684 316bc5852782 2024-09-17T09:13:02.863 INFO:teuthology.orchestra.run.smithi042.stdout:osd.1 smithi161 running (116s) 57s ago 115s 58.3M 4096M 18.2.4-855-g19e2a2be 980a0bfcd684 0ecd4327e26c 2024-09-17T09:13:02.864 INFO:teuthology.orchestra.run.smithi042.stdout:osd.2 smithi179 running (92s) 55s ago 92s 48.9M 4096M 18.2.4-855-g19e2a2be 980a0bfcd684 cc8df4bc01f3 2024-09-17T09:13:02.864 INFO:teuthology.orchestra.run.smithi042.stdout:prometheus.a smithi161 *:9095 starting - - - - 2024-09-17T09:13:02.864 INFO:teuthology.orchestra.run.smithi042.stdout:rgw.foo.a smithi042 *:80 running (73s) 48s ago 72s 74.0M - 18.2.4-855-g19e2a2be 980a0bfcd684 f21157d9d39f 2024-09-17T09:13:02.864 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:02 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ::ffff:172.21.15.161 - - [17/Sep/2024:09:13:02] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:13:03.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-17T09:13:03.686 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:13:04.018 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:03 smithi161 bash[38935]: Writing manifest to image destination 2024-09-17T09:13:04.298 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 podman[38935]: 2024-09-17 09:13:03.981079677 +0000 UTC m=+2.259004533 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-17T09:13:04.298 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 podman[38935]: 2024-09-17 09:13:04.088020799 +0000 UTC m=+2.365945690 container create 5f41a47386b2d4d0d0132e91ccc75be022ef991e215df585d93353099da950ad (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T09:13:04.298 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 podman[38935]: 2024-09-17 09:13:04.29801214 +0000 UTC m=+2.575936989 container init 5f41a47386b2d4d0d0132e91ccc75be022ef991e215df585d93353099da950ad (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T09:13:04.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:04 smithi042 ceph-mon[25899]: pgmap v24: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:04.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:04 smithi042 ceph-mon[25899]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:04.738 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-mon[27677]: pgmap v24: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:04.738 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-mon[27677]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 podman[38935]: 2024-09-17 09:13:04.302678716 +0000 UTC m=+2.580603566 container start 5f41a47386b2d4d0d0132e91ccc75be022ef991e215df585d93353099da950ad (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.305Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.305Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.306Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.306Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.306Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.306Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-17T09:13:04.739 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=arp 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-17T09:13:04.740 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=edac 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-17T09:13:04.741 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=os 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-17T09:13:04.742 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=stat 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=time 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=uname 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-17T09:13:04.743 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-17T09:13:04.744 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-17T09:13:04.744 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b[39088]: ts=2024-09-17T09:13:04.307Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-17T09:13:04.744 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 bash[38935]: 5f41a47386b2d4d0d0132e91ccc75be022ef991e215df585d93353099da950ad 2024-09-17T09:13:04.744 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:13:04 smithi161 systemd[1]: Started Ceph node-exporter.b for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:13:04.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:04 smithi179 ceph-mon[27782]: pgmap v24: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:04.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:04 smithi179 ceph-mon[27782]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:05.334 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:05 smithi179 systemd[1]: Starting Ceph node-exporter.c for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:agent 3/3 60s ago 45s * 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:alertmanager ?:9093,9094 0/1 - 68s smithi042=a;count:1 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:grafana ?:3000 0/1 - 65s smithi161=a;count:1 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:mgr 3/3 60s ago 2m smithi042=y;smithi161=x;smithi179=z;count:3 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:mon 3/3 60s ago 3m smithi042:172.21.15.42=a;smithi161:172.21.15.161=b;smithi179:172.21.15.179=c;count:3 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:node-exporter ?:9100 0/3 - 71s smithi042=a;smithi161=b;smithi179=c;count:3 2024-09-17T09:13:05.672 INFO:teuthology.orchestra.run.smithi042.stdout:osd 3 60s ago - 2024-09-17T09:13:05.673 INFO:teuthology.orchestra.run.smithi042.stdout:prometheus ?:9095 0/1 - 75s smithi161=a;count:1 2024-09-17T09:13:05.673 INFO:teuthology.orchestra.run.smithi042.stdout:rgw.foo.a ?:80 1/1 51s ago 75s smithi042=foo.a;count:1 2024-09-17T09:13:05.673 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:05 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.673 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:05 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.673 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:05 smithi042 ceph-mon[25899]: pgmap v25: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:05.673 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:05 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.673 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:05 smithi042 ceph-mon[25899]: Deploying daemon node-exporter.c on smithi179 2024-09-17T09:13:05.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:05 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:05 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:05 smithi179 ceph-mon[27782]: pgmap v25: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:05.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:05 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.692 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:05 smithi179 ceph-mon[27782]: Deploying daemon node-exporter.c on smithi179 2024-09-17T09:13:05.692 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:05 smithi179 bash[38834]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-09-17T09:13:05.692 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:05 smithi179 bash[38834]: Getting image source signatures 2024-09-17T09:13:05.692 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:05 smithi179 bash[38834]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-09-17T09:13:05.693 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:05 smithi179 bash[38834]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-09-17T09:13:05.693 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:05 smithi179 bash[38834]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-09-17T09:13:05.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:05 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:05 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:05 smithi161 ceph-mon[27677]: pgmap v25: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:05.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:05 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:05.769 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:05 smithi161 ceph-mon[27677]: Deploying daemon node-exporter.c on smithi179 2024-09-17T09:13:06.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:06 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:13:06.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:06 smithi042 ceph-mon[25899]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:06.568 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-17T09:13:06.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:06 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:13:06.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:06 smithi161 ceph-mon[27677]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:06.778 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:06 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:13:06.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:06 smithi179 ceph-mon[27782]: from='client.14541 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:07.017 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:13:07.279 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:06 smithi179 bash[38834]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-09-17T09:13:07.279 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 bash[38834]: Writing manifest to image destination 2024-09-17T09:13:07.532 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:07 smithi042 ceph-mon[25899]: pgmap v26: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:07.740 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-mon[27782]: pgmap v26: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:07.740 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 podman[38834]: 2024-09-17 09:13:07.431261807 +0000 UTC m=+2.189322973 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-09-17T09:13:07.740 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 podman[38834]: 2024-09-17 09:13:07.512650145 +0000 UTC m=+2.270711301 container create 5f0766b0b7454199b3f1825119542d72cc18cdd0e7d6f106bb930a35fb509e3b (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c, maintainer=The Prometheus Authors ) 2024-09-17T09:13:07.740 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 podman[38834]: 2024-09-17 09:13:07.739880169 +0000 UTC m=+2.497941330 container init 5f0766b0b7454199b3f1825119542d72cc18cdd0e7d6f106bb930a35fb509e3b (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c, maintainer=The Prometheus Authors ) 2024-09-17T09:13:07.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:07 smithi161 ceph-mon[27677]: pgmap v26: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:08.029 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 podman[38834]: 2024-09-17 09:13:07.7449035 +0000 UTC m=+2.502964657 container start 5f0766b0b7454199b3f1825119542d72cc18cdd0e7d6f106bb930a35fb509e3b (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c, maintainer=The Prometheus Authors ) 2024-09-17T09:13:08.029 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.748Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-09-17T09:13:08.029 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.748Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-09-17T09:13:08.029 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-09-17T09:13:08.029 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=arp 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=bcache 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=bonding 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=btrfs 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=conntrack 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=cpu 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=diskstats 2024-09-17T09:13:08.030 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=dmi 2024-09-17T09:13:08.031 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=edac 2024-09-17T09:13:08.031 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=entropy 2024-09-17T09:13:08.031 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-09-17T09:13:08.031 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=filefd 2024-09-17T09:13:08.031 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=filesystem 2024-09-17T09:13:08.031 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=hwmon 2024-09-17T09:13:08.031 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=infiniband 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=ipvs 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=loadavg 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=mdadm 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=meminfo 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=netclass 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=netdev 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=netstat 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=nfs 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=nfsd 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=nvme 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=os 2024-09-17T09:13:08.032 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=pressure 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=rapl 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=schedstat 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=selinux 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=sockstat 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=softnet 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=stat 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=tapestats 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=textfile 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=time 2024-09-17T09:13:08.033 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=uname 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=vmstat 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=xfs 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.749Z caller=node_exporter.go:117 level=info collector=zfs 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.750Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c[38991]: ts=2024-09-17T09:13:07.750Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 bash[38834]: 5f0766b0b7454199b3f1825119542d72cc18cdd0e7d6f106bb930a35fb509e3b 2024-09-17T09:13:08.034 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:13:07 smithi179 systemd[1]: Started Ceph node-exporter.c for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi042", "caps": []}]: dispatch 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi161", "caps": []}]: dispatch 2024-09-17T09:13:08.975 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:08 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi042", "caps": []}]: dispatch 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi161", "caps": []}]: dispatch 2024-09-17T09:13:09.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:08 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-17T09:13:09.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.268 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:09.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-17T09:13:09.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi042", "caps": []}]: dispatch 2024-09-17T09:13:09.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi161", "caps": []}]: dispatch 2024-09-17T09:13:09.269 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:08 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi179", "caps": []}]: dispatch 2024-09-17T09:13:10.070 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:09 smithi042 ceph-mon[25899]: pgmap v27: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:10.155 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:09 smithi179 ceph-mon[27782]: pgmap v27: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:10.187 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:09 smithi161 ceph-mon[27677]: pgmap v27: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:10.856 INFO:teuthology.orchestra.run.smithi042.stdout:HOST ADDR LABELS STATUS 2024-09-17T09:13:10.856 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 172.21.15.42 2024-09-17T09:13:10.857 INFO:teuthology.orchestra.run.smithi042.stdout:smithi161 172.21.15.161 2024-09-17T09:13:10.857 INFO:teuthology.orchestra.run.smithi042.stdout:smithi179 172.21.15.179 2024-09-17T09:13:10.857 INFO:teuthology.orchestra.run.smithi042.stdout:3 hosts in cluster 2024-09-17T09:13:11.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:11 smithi042 ceph-mon[25899]: Reconfiguring daemon agent.smithi161 on smithi161 2024-09-17T09:13:11.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:11 smithi042 ceph-mon[25899]: Reconfiguring daemon agent.smithi179 on smithi179 2024-09-17T09:13:11.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:11 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:11 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:11 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.368 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:11 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.388 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-17T09:13:11.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:11 smithi161 ceph-mon[27677]: Reconfiguring daemon agent.smithi161 on smithi161 2024-09-17T09:13:11.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:11 smithi161 ceph-mon[27677]: Reconfiguring daemon agent.smithi179 on smithi179 2024-09-17T09:13:11.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:11 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:11 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:11 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:11 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:11 smithi179 ceph-mon[27782]: Reconfiguring daemon agent.smithi161 on smithi161 2024-09-17T09:13:11.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:11 smithi179 ceph-mon[27782]: Reconfiguring daemon agent.smithi179 on smithi179 2024-09-17T09:13:11.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:11 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:11 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:11 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:11.529 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:11 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:12.364 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:13:12.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:12 smithi042 ceph-mon[25899]: pgmap v28: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:12.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:12 smithi042 ceph-mon[25899]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:12.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:12 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:12.518 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:12 smithi179 ceph-mon[27782]: pgmap v28: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:12.519 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:12 smithi179 ceph-mon[27782]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:12.519 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:12 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:12.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:12 smithi161 ceph-mon[27677]: pgmap v28: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:12.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:12 smithi161 ceph-mon[27677]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:12.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:12 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:12.974 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ::ffff:172.21.15.161 - - [17/Sep/2024:09:13:12] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:13:14.461 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:14 smithi042 ceph-mon[25899]: pgmap v29: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:14.473 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:14 smithi179 ceph-mon[27782]: pgmap v29: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:14.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:14 smithi161 ceph-mon[27677]: pgmap v29: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:15.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:15 smithi161 ceph-mon[27677]: pgmap v30: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:15.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:15 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:15.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:15 smithi179 ceph-mon[27782]: pgmap v30: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:15.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:15 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:15.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:15 smithi042 ceph-mon[25899]: pgmap v30: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:15.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:15 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:16.304 INFO:teuthology.orchestra.run.smithi042.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-17T09:13:16.304 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130021480DGN 447G No 80s ago Has a FileSystem, LVM detected 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme1n1 ssd Linux_fc43f448c65ba9dbfdc3 89.4G No 80s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme2n1 ssd Linux_f6df757c291092e3ebc8 89.4G Yes 80s ago 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme3n1 ssd Linux_c2498412215c5097b081 89.4G Yes 80s ago 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/nvme4n1 ssd Linux_bdad157bf0b30d63c488 89.4G Yes 80s ago 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042 /dev/sda hdd ATA_ST1000NM0033-9ZM173_Z1W4J2MS 931G No 80s ago Has partitions 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi161 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001X400BGN 372G No 70s ago Has a FileSystem, LVM detected 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi161 /dev/nvme1n1 ssd Linux_6b4b092bb1b95d90cb09 89.4G No 70s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi161 /dev/nvme2n1 ssd Linux_23b701aa144fd3699559 89.4G Yes 70s ago 2024-09-17T09:13:16.305 INFO:teuthology.orchestra.run.smithi042.stdout:smithi161 /dev/nvme3n1 ssd Linux_018cc697dd69583af748 89.4G Yes 70s ago 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi161 /dev/nvme4n1 ssd Linux_68adbbe58ce157a36796 89.4G Yes 70s ago 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi161 /dev/sda hdd ATA_ST1000NM0033-9ZM173_Z1W5XV0E 931G No 70s ago Has partitions 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi179 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009J400BGN 372G No 68s ago Has a FileSystem, LVM detected 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi179 /dev/nvme1n1 ssd Linux_4d2f48bc57c16c284eb3 89.4G No 68s ago Has a FileSystem, Insufficient space (<10 extents) on vgs, LVM detected 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi179 /dev/nvme2n1 ssd Linux_3177dee585d51eac40d3 89.4G Yes 68s ago 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi179 /dev/nvme3n1 ssd Linux_5a9bc9179530e8cc0b3a 89.4G Yes 68s ago 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi179 /dev/nvme4n1 ssd Linux_7d9137e9d05dc453c218 89.4G Yes 68s ago 2024-09-17T09:13:16.306 INFO:teuthology.orchestra.run.smithi042.stdout:smithi179 /dev/sda hdd ATA_ST1000NM0033-9ZM173_Z1W5XFX4 931G No 68s ago Has partitions 2024-09-17T09:13:16.644 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:16 smithi161 ceph-mon[27677]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:16.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls --format yaml' 2024-09-17T09:13:16.838 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:16 smithi179 ceph-mon[27782]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:16.853 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:16 smithi042 ceph-mon[25899]: from='client.14553 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:18.278 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:18 smithi179 ceph-mon[27782]: pgmap v31: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:18.278 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:18 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.278 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:18 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:18 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:18 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:18 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.279 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:18 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.428 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:13:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:18 smithi042 ceph-mon[25899]: pgmap v31: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:18 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:18 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:18 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:18 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:18 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.475 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:18 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:18 smithi161 ceph-mon[27677]: pgmap v31: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:18.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:18 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:18 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.518 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:18 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:18 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:18 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:18.519 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:18 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: pgmap v32: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.820 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.821 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:19 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.901 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: pgmap v32: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:19.901 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.901 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.901 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.901 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.901 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.902 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.902 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.902 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:19.902 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:19 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: pgmap v32: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:20.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.030 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:19 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:20.802 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: agent 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: agent 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout: host_pattern: '*' 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:12:20.450025Z' 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:17.153045Z' 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout: running: 3 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout: size: 3 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout:events: 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout:- 2024-09-17T09:12:22.084257Z service:agent [INFO] "service was created" 2024-09-17T09:13:20.803 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: alertmanager 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: alertmanager 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: count: 1 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: hosts: 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi042=a 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:11:57.645139Z' 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:19.371359Z' 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: ports: 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: - 9093 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: - 9094 2024-09-17T09:13:20.804 INFO:teuthology.orchestra.run.smithi042.stdout: running: 1 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout: size: 1 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout:events: 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout:- 2024-09-17T09:12:42.111034Z service:alertmanager [INFO] "service was created" 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: grafana 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: grafana 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout: count: 1 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout: hosts: 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi161=a 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout:spec: 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout: anonymous_access: true 2024-09-17T09:13:20.805 INFO:teuthology.orchestra.run.smithi042.stdout: protocol: https 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:12:00.202206Z' 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:18.130808Z' 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout: ports: 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout: - 3000 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout: running: 1 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout: size: 1 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout:events: 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout:- 2024-09-17T09:12:54.308331Z service:grafana [INFO] "service was created" 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: mgr 2024-09-17T09:13:20.806 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: mgr 2024-09-17T09:13:20.807 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.807 INFO:teuthology.orchestra.run.smithi042.stdout: count: 3 2024-09-17T09:13:20.807 INFO:teuthology.orchestra.run.smithi042.stdout: hosts: 2024-09-17T09:13:20.807 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi042=y 2024-09-17T09:13:20.807 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi161=x 2024-09-17T09:13:20.807 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi179=z 2024-09-17T09:13:20.808 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.808 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:10:17.197735Z' 2024-09-17T09:13:20.808 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:17.153208Z' 2024-09-17T09:13:20.808 INFO:teuthology.orchestra.run.smithi042.stdout: running: 3 2024-09-17T09:13:20.808 INFO:teuthology.orchestra.run.smithi042.stdout: size: 3 2024-09-17T09:13:20.808 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.809 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: mon 2024-09-17T09:13:20.809 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: mon 2024-09-17T09:13:20.809 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.809 INFO:teuthology.orchestra.run.smithi042.stdout: count: 3 2024-09-17T09:13:20.809 INFO:teuthology.orchestra.run.smithi042.stdout: hosts: 2024-09-17T09:13:20.809 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi042:172.21.15.42=a 2024-09-17T09:13:20.810 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi161:172.21.15.161=b 2024-09-17T09:13:20.810 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi179:172.21.15.179=c 2024-09-17T09:13:20.810 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.810 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:09:50.362732Z' 2024-09-17T09:13:20.810 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:17.153141Z' 2024-09-17T09:13:20.811 INFO:teuthology.orchestra.run.smithi042.stdout: running: 3 2024-09-17T09:13:20.811 INFO:teuthology.orchestra.run.smithi042.stdout: size: 3 2024-09-17T09:13:20.811 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.812 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: node-exporter 2024-09-17T09:13:20.812 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: node-exporter 2024-09-17T09:13:20.813 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: count: 3 2024-09-17T09:13:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: hosts: 2024-09-17T09:13:20.813 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi042=a 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi161=b 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi179=c 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:11:54.207034Z' 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:17.153331Z' 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: ports: 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: - 9100 2024-09-17T09:13:20.814 INFO:teuthology.orchestra.run.smithi042.stdout: running: 3 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout: size: 3 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout:events: 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout:- 2024-09-17T09:13:07.907849Z service:node-exporter [INFO] "service was created" 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: osd 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: osd 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout:unmanaged: true 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout:spec: 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout: filter_logic: AND 2024-09-17T09:13:20.815 INFO:teuthology.orchestra.run.smithi042.stdout: objectstore: bluestore 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout: container_image_id: 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout: container_image_name: quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:17.153270Z' 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout: running: 3 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout: size: 3 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: prometheus 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: prometheus 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout: count: 1 2024-09-17T09:13:20.816 INFO:teuthology.orchestra.run.smithi042.stdout: hosts: 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi161=a 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:11:49.984432Z' 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:18.130737Z' 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: ports: 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: - 9095 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: running: 1 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout: size: 1 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout:events: 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout:- 2024-09-17T09:13:07.916916Z service:prometheus [INFO] "service was created" 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout:--- 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout:service_type: rgw 2024-09-17T09:13:20.817 INFO:teuthology.orchestra.run.smithi042.stdout:service_id: foo.a 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout:service_name: rgw.foo.a 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout:placement: 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: count: 1 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: hosts: 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: - smithi042=foo.a 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout:status: 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: created: '2024-09-17T09:11:50.480062Z' 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: last_refresh: '2024-09-17T09:13:19.371302Z' 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: ports: 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: - 80 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: running: 1 2024-09-17T09:13:20.818 INFO:teuthology.orchestra.run.smithi042.stdout: size: 1 2024-09-17T09:13:21.453 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-09-17T09:13:21.699 INFO:teuthology.orchestra.run.smithi042.stderr:Inferring config /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/mon.a/config 2024-09-17T09:13:21.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:21 smithi042 ceph-mon[25899]: pgmap v33: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:21.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:21 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:13:21.710 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:21 smithi042 ceph-mon[25899]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2024-09-17T09:13:21.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:21 smithi042 ceph-mon[25899]: Detected new or changed devices on smithi179 2024-09-17T09:13:21.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:21 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:21.711 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:21 smithi042 ceph-mon[25899]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:21.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:21 smithi179 ceph-mon[27782]: pgmap v33: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:21.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:21 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:13:21.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:21 smithi179 ceph-mon[27782]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2024-09-17T09:13:21.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:21 smithi179 ceph-mon[27782]: Detected new or changed devices on smithi179 2024-09-17T09:13:21.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:21 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:21.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:21 smithi179 ceph-mon[27782]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:21.989 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:21 smithi161 ceph-mon[27677]: pgmap v33: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:21.989 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:21 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-17T09:13:21.989 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:21 smithi161 ceph-mon[27677]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "yaml"}]: dispatch 2024-09-17T09:13:21.989 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:21 smithi161 ceph-mon[27677]: Detected new or changed devices on smithi179 2024-09-17T09:13:21.989 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:21 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:21.989 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:21 smithi161 ceph-mon[27677]: from='mgr.14427 172.21.15.42:0/4189187999' entity='mgr.y' 2024-09-17T09:13:22.784 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:22 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: ::ffff:172.21.15.161 - - [17/Sep/2024:09:13:22] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-09-17T09:13:23.471 INFO:teuthology.orchestra.run.smithi042.stdout:osd 3 6s ago - 2024-09-17T09:13:23.724 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:23 smithi042 ceph-mon[25899]: pgmap v34: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:23.796 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:23 smithi161 ceph-mon[27677]: pgmap v34: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:24.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:23 smithi179 ceph-mon[27782]: pgmap v34: 129 pgs: 129 active+clean; 582 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-09-17T09:13:24.040 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-17T09:13:24.049 INFO:tasks.cephadm:Teardown begin 2024-09-17T09:13:24.050 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:13:24.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:13:24.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:13:24.147 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-17T09:13:24.147 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T09:13:24.164 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T09:13:24.180 DEBUG:teuthology.orchestra.run.smithi179:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-17T09:13:24.205 INFO:tasks.cephadm:Stopping all daemons... 2024-09-17T09:13:24.205 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-17T09:13:24.205 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a 2024-09-17T09:13:24.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:24 smithi042 systemd[1]: Stopping Ceph mon.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:24.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-mon[25899]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:24.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a[25876]: 2024-09-17T09:13:24.662+0000 7f25f2d77640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:24.795 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a[25876]: 2024-09-17T09:13:24.662+0000 7f25f2d77640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-17T09:13:24.796 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:13:24] ENGINE Bus STOPPING 2024-09-17T09:13:24.796 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:13:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-09-17T09:13:24.796 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:13:24] ENGINE Bus STOPPED 2024-09-17T09:13:24.796 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:13:24] ENGINE Bus STARTING 2024-09-17T09:13:24.796 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:13:24] ENGINE Serving on http://:::9283 2024-09-17T09:13:24.796 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:24 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: [17/Sep/2024:09:13:24] ENGINE Bus STARTED 2024-09-17T09:13:24.799 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:24 smithi161 ceph-mon[27677]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:25.029 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:24 smithi179 ceph-mon[27782]: from='client.14565 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-17T09:13:25.161 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:24 smithi042 podman[50988]: 2024-09-17 09:13:24.898763595 +0000 UTC m=+0.503293758 container died 01fa157211b768aef358ede997cd7e993590a1be7d851bc4b93e26281f5bf5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T09:13:25.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:25 smithi042 podman[50988]: 2024-09-17 09:13:25.335632126 +0000 UTC m=+0.940162331 container cleanup 01fa157211b768aef358ede997cd7e993590a1be7d851bc4b93e26281f5bf5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=reef-19e2a2b, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-17T09:13:25.474 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:25 smithi042 bash[50988]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a 2024-09-17T09:13:25.730 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service' 2024-09-17T09:13:25.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:25 smithi042 podman[51016]: 2024-09-17 09:13:25.503534944 +0000 UTC m=+0.602528838 container remove 01fa157211b768aef358ede997cd7e993590a1be7d851bc4b93e26281f5bf5cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-17T09:13:25.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:25 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-17T09:13:25.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:25 smithi042 systemd[1]: Stopped Ceph mon.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:13:25.755 INFO:journalctl@ceph.mon.a.smithi042.stdout:Sep 17 09:13:25 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.a.service: Consumed 10.630s CPU time. 2024-09-17T09:13:25.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:25.787 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-17T09:13:25.787 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-17T09:13:25.787 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.b 2024-09-17T09:13:26.098 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:25 smithi161 systemd[1]: Stopping Ceph mon.b for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:26.462 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-b[27654]: 2024-09-17T09:13:26.096+0000 7f4076101640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:26.462 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:26 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-b[27654]: 2024-09-17T09:13:26.096+0000 7f4076101640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-17T09:13:26.463 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:26 smithi161 podman[45552]: 2024-09-17 09:13:26.209727106 +0000 UTC m=+0.229594558 container died cf885518b748f9e1fd79405acaf956b09ab559b63c7eb4843bca9cd86c99238c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T09:13:26.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:26 smithi161 podman[45552]: 2024-09-17 09:13:26.552850893 +0000 UTC m=+0.572718333 container cleanup cf885518b748f9e1fd79405acaf956b09ab559b63c7eb4843bca9cd86c99238c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-17T09:13:26.768 INFO:journalctl@ceph.mon.b.smithi161.stdout:Sep 17 09:13:26 smithi161 bash[45552]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-b 2024-09-17T09:13:27.049 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.b.service' 2024-09-17T09:13:27.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:27.094 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-17T09:13:27.094 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-17T09:13:27.095 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.c 2024-09-17T09:13:27.404 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:27 smithi179 systemd[1]: Stopping Ceph mon.c for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:27.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:27 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-c[27759]: 2024-09-17T09:13:27.402+0000 7ffaafa14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:27.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:27 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-c[27759]: 2024-09-17T09:13:27.402+0000 7ffaafa14640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-17T09:13:27.779 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:27 smithi179 podman[44814]: 2024-09-17 09:13:27.526037869 +0000 UTC m=+0.236795834 container died 2bdf791b79e39c7e9fcaab612578b472e3069b248bdde2b951f9bb64765ab0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-17T09:13:28.170 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:27 smithi179 podman[44814]: 2024-09-17 09:13:27.935727663 +0000 UTC m=+0.646485660 container cleanup 2bdf791b79e39c7e9fcaab612578b472e3069b248bdde2b951f9bb64765ab0f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-17T09:13:28.171 INFO:journalctl@ceph.mon.c.smithi179.stdout:Sep 17 09:13:27 smithi179 bash[44814]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mon-c 2024-09-17T09:13:28.290 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mon.c.service' 2024-09-17T09:13:28.336 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:28.336 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-17T09:13:28.336 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-17T09:13:28.336 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y 2024-09-17T09:13:28.642 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:28 smithi042 systemd[1]: Stopping Ceph mgr.y for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:28.932 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:28 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:13:28.641+0000 7f9ecf9da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:28.932 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:28 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y[26151]: 2024-09-17T09:13:28.641+0000 7f9ecf9da640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-17T09:13:28.932 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:28 smithi042 podman[51130]: 2024-09-17 09:13:28.672636669 +0000 UTC m=+0.131874910 container died 2fc2c023ed1ebc3ee47d6bdc6c6323d37aedd75e11c960ffb9d7cee3af0bdfe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T09:13:29.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:29 smithi042 podman[51130]: 2024-09-17 09:13:29.106424384 +0000 UTC m=+0.565662614 container cleanup 2fc2c023ed1ebc3ee47d6bdc6c6323d37aedd75e11c960ffb9d7cee3af0bdfe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-17T09:13:29.224 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:29 smithi042 bash[51130]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y 2024-09-17T09:13:29.541 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-17T09:13:29.563 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:29 smithi042 podman[51150]: 2024-09-17 09:13:29.29959293 +0000 UTC m=+0.622097638 container remove 2fc2c023ed1ebc3ee47d6bdc6c6323d37aedd75e11c960ffb9d7cee3af0bdfe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:19e2a2beb6f41a3ab62650e38614eb29b59dcbb9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-17T09:13:29.563 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:29 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y.service: Deactivated successfully. 2024-09-17T09:13:29.563 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:29 smithi042 systemd[1]: Stopped Ceph mgr.y for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:13:29.564 INFO:journalctl@ceph.mgr.y.smithi042.stdout:Sep 17 09:13:29 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.y.service: Consumed 1min 9.224s CPU time. 2024-09-17T09:13:29.576 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:29.576 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-17T09:13:29.576 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-17T09:13:29.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.x 2024-09-17T09:13:29.916 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:13:29 smithi161 systemd[1]: Stopping Ceph mgr.x for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:30.207 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:13:29 smithi161 podman[45685]: 2024-09-17 09:13:29.916568848 +0000 UTC m=+0.141178765 container died a7b5de7a3526aad1a26f672dab09a37d7e95c56bca9c32426a7bfd822dfb5181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-17T09:13:30.518 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:13:30 smithi161 podman[45685]: 2024-09-17 09:13:30.289885273 +0000 UTC m=+0.514495175 container cleanup a7b5de7a3526aad1a26f672dab09a37d7e95c56bca9c32426a7bfd822dfb5181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b) 2024-09-17T09:13:30.518 INFO:journalctl@ceph.mgr.x.smithi161.stdout:Sep 17 09:13:30 smithi161 bash[45685]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-x 2024-09-17T09:13:30.713 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-17T09:13:30.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:30.747 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-17T09:13:30.748 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-17T09:13:30.748 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.z 2024-09-17T09:13:31.029 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:13:30 smithi179 systemd[1]: Stopping Ceph mgr.z for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:31.341 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:13:31 smithi179 podman[44944]: 2024-09-17 09:13:31.063215371 +0000 UTC m=+0.124221422 container died a516ef5b2114e17ee33d78d70207d2e7f3141835830f897e1578e6542f0d6f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-17T09:13:31.700 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:13:31 smithi179 podman[44944]: 2024-09-17 09:13:31.440391334 +0000 UTC m=+0.501397375 container cleanup a516ef5b2114e17ee33d78d70207d2e7f3141835830f897e1578e6542f0d6f37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-17T09:13:31.700 INFO:journalctl@ceph.mgr.z.smithi179.stdout:Sep 17 09:13:31 smithi179 bash[44944]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-mgr-z 2024-09-17T09:13:31.871 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-17T09:13:31.905 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:31.905 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-17T09:13:31.906 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-17T09:13:31.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.0 2024-09-17T09:13:32.189 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:31 smithi042 systemd[1]: Stopping Ceph osd.0 for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:32.474 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:32 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0[37910]: 2024-09-17T09:13:32.208+0000 7fd3e3d70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:32.474 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:32 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0[37910]: 2024-09-17T09:13:32.208+0000 7fd3e3d70640 -1 osd.0 32 *** Got signal Terminated *** 2024-09-17T09:13:32.475 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:32 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0[37910]: 2024-09-17T09:13:32.208+0000 7fd3e3d70640 -1 osd.0 32 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:38.104 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:37 smithi042 podman[51261]: 2024-09-17 09:13:37.831326145 +0000 UTC m=+5.735173190 container died 316bc5852782862ef7e62a30faadd7269eb363c1470cb94154f84026a7b5f652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T09:13:38.421 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:38 smithi042 podman[51261]: 2024-09-17 09:13:38.261304693 +0000 UTC m=+6.165151733 container cleanup 316bc5852782862ef7e62a30faadd7269eb363c1470cb94154f84026a7b5f652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True) 2024-09-17T09:13:38.421 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:38 smithi042 bash[51261]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0 2024-09-17T09:13:38.724 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:38 smithi042 podman[51836]: 2024-09-17 09:13:38.420930924 +0000 UTC m=+0.713822015 container remove 316bc5852782862ef7e62a30faadd7269eb363c1470cb94154f84026a7b5f652 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-17T09:13:40.105 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:39 smithi042 podman[52038]: 2024-09-17 09:13:39.771351427 +0000 UTC m=+0.016958487 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:13:40.105 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:39 smithi042 podman[52038]: 2024-09-17 09:13:39.911140314 +0000 UTC m=+0.156747439 container create 8bac6f71893fb0fbc6c55f72dcf1067165113d39301be68199bbdb549484d4fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-17T09:13:40.105 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:40 smithi042 podman[52038]: 2024-09-17 09:13:40.105055 +0000 UTC m=+0.350662072 container init 8bac6f71893fb0fbc6c55f72dcf1067165113d39301be68199bbdb549484d4fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-17T09:13:40.475 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:40 smithi042 podman[52038]: 2024-09-17 09:13:40.110504492 +0000 UTC m=+0.356111552 container start 8bac6f71893fb0fbc6c55f72dcf1067165113d39301be68199bbdb549484d4fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS) 2024-09-17T09:13:40.475 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:40 smithi042 podman[52038]: 2024-09-17 09:13:40.19657834 +0000 UTC m=+0.442185407 container attach 8bac6f71893fb0fbc6c55f72dcf1067165113d39301be68199bbdb549484d4fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-17T09:13:40.475 INFO:journalctl@ceph.osd.0.smithi042.stdout:Sep 17 09:13:40 smithi042 podman[52038]: 2024-09-17 09:13:40.298691578 +0000 UTC m=+0.544298639 container died 8bac6f71893fb0fbc6c55f72dcf1067165113d39301be68199bbdb549484d4fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-17T09:13:40.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.0.service' 2024-09-17T09:13:40.975 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:40.976 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-17T09:13:40.976 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-17T09:13:40.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.1 2024-09-17T09:13:41.268 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:41 smithi161 systemd[1]: Stopping Ceph osd.1 for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:41.768 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:41 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1[32985]: 2024-09-17T09:13:41.294+0000 7f9ac5dea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:41.768 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:41 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1[32985]: 2024-09-17T09:13:41.294+0000 7f9ac5dea640 -1 osd.1 32 *** Got signal Terminated *** 2024-09-17T09:13:41.768 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:41 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1[32985]: 2024-09-17T09:13:41.294+0000 7f9ac5dea640 -1 osd.1 32 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:46.937 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:46 smithi161 podman[46524]: 2024-09-17 09:13:46.666980448 +0000 UTC m=+5.479981960 container died 0ecd4327e26cd2afbbabe0b26801b7e44f3b10f3af85f33c11d8724e7c9e8ac4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, ceph=True, RELEASE=reef-19e2a2b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T09:13:47.227 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 podman[46524]: 2024-09-17 09:13:47.017562104 +0000 UTC m=+5.830563614 container cleanup 0ecd4327e26cd2afbbabe0b26801b7e44f3b10f3af85f33c11d8724e7c9e8ac4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b) 2024-09-17T09:13:47.227 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 bash[46524]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1 2024-09-17T09:13:47.518 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 podman[46544]: 2024-09-17 09:13:47.226794245 +0000 UTC m=+0.551255633 container remove 0ecd4327e26cd2afbbabe0b26801b7e44f3b10f3af85f33c11d8724e7c9e8ac4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-17T09:13:47.938 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 podman[46639]: 2024-09-17 09:13:47.530109711 +0000 UTC m=+0.016353757 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:13:47.938 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 podman[46639]: 2024-09-17 09:13:47.635889689 +0000 UTC m=+0.122133725 container create 666a53cd98a2f39df0185e7c6acabe7fcbe42ceba9dbfba21376c38d80588b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T09:13:47.938 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 podman[46639]: 2024-09-17 09:13:47.854616084 +0000 UTC m=+0.340860124 container init 666a53cd98a2f39df0185e7c6acabe7fcbe42ceba9dbfba21376c38d80588b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, CEPH_POINT_RELEASE=) 2024-09-17T09:13:47.938 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 podman[46639]: 2024-09-17 09:13:47.859407629 +0000 UTC m=+0.345651679 container start 666a53cd98a2f39df0185e7c6acabe7fcbe42ceba9dbfba21376c38d80588b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-17T09:13:47.938 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:47 smithi161 podman[46639]: 2024-09-17 09:13:47.937812812 +0000 UTC m=+0.424056865 container attach 666a53cd98a2f39df0185e7c6acabe7fcbe42ceba9dbfba21376c38d80588b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T09:13:48.268 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:48 smithi161 podman[46639]: 2024-09-17 09:13:48.04993951 +0000 UTC m=+0.536183555 container died 666a53cd98a2f39df0185e7c6acabe7fcbe42ceba9dbfba21376c38d80588b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-17T09:13:48.649 INFO:journalctl@ceph.osd.1.smithi161.stdout:Sep 17 09:13:48 smithi161 podman[46683]: 2024-09-17 09:13:48.632595153 +0000 UTC m=+0.576770114 container remove 666a53cd98a2f39df0185e7c6acabe7fcbe42ceba9dbfba21376c38d80588b6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-17T09:13:48.654 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.1.service' 2024-09-17T09:13:48.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:48.693 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-17T09:13:48.693 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-17T09:13:48.693 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.2 2024-09-17T09:13:49.002 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:48 smithi179 systemd[1]: Stopping Ceph osd.2 for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:49.279 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:49 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2[34147]: 2024-09-17T09:13:49.000+0000 7f029f89c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:49.279 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:49 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2[34147]: 2024-09-17T09:13:49.000+0000 7f029f89c640 -1 osd.2 32 *** Got signal Terminated *** 2024-09-17T09:13:49.279 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:49 smithi179 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2[34147]: 2024-09-17T09:13:49.000+0000 7f029f89c640 -1 osd.2 32 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-17T09:13:54.740 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:54 smithi179 podman[45618]: 2024-09-17 09:13:54.462956105 +0000 UTC m=+5.568890282 container died cc8df4bc01f309453bf591ea9ecdbbe2c598053d1088415c93673ff44d6a677a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T09:13:55.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:54 smithi179 podman[45618]: 2024-09-17 09:13:54.822019232 +0000 UTC m=+5.927953409 container cleanup cc8df4bc01f309453bf591ea9ecdbbe2c598053d1088415c93673ff44d6a677a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-17T09:13:55.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:54 smithi179 bash[45618]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2 2024-09-17T09:13:55.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:54 smithi179 podman[45977]: 2024-09-17 09:13:54.981763329 +0000 UTC m=+0.570775828 container remove cc8df4bc01f309453bf591ea9ecdbbe2c598053d1088415c93673ff44d6a677a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-17T09:13:57.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:56 smithi179 podman[46182]: 2024-09-17 09:13:56.570696105 +0000 UTC m=+0.018716555 image pull 980a0bfcd684674f25c08d857ad8de3b1c8ae738870529edbf9aa463832c8d89 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9 2024-09-17T09:13:57.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:56 smithi179 podman[46182]: 2024-09-17 09:13:56.691361979 +0000 UTC m=+0.139382416 container create 07ffb97112ebe9bf0cba68135a8caecce4557f34429ade6eb8701f953cf43483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-17T09:13:57.529 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:57 smithi179 podman[46182]: 2024-09-17 09:13:57.211776305 +0000 UTC m=+0.659796753 container init 07ffb97112ebe9bf0cba68135a8caecce4557f34429ade6eb8701f953cf43483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=reef-19e2a2b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-17T09:13:57.529 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:57 smithi179 podman[46182]: 2024-09-17 09:13:57.217361649 +0000 UTC m=+0.665382086 container start 07ffb97112ebe9bf0cba68135a8caecce4557f34429ade6eb8701f953cf43483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=reef-19e2a2b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD) 2024-09-17T09:13:57.529 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:57 smithi179 podman[46182]: 2024-09-17 09:13:57.295112669 +0000 UTC m=+0.743133109 container attach 07ffb97112ebe9bf0cba68135a8caecce4557f34429ade6eb8701f953cf43483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-17T09:13:58.029 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:57 smithi179 podman[46182]: 2024-09-17 09:13:57.742114905 +0000 UTC m=+1.190135388 container died 07ffb97112ebe9bf0cba68135a8caecce4557f34429ade6eb8701f953cf43483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=reef-19e2a2b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T09:13:58.301 INFO:journalctl@ceph.osd.2.smithi179.stdout:Sep 17 09:13:58 smithi179 podman[46277]: 2024-09-17 09:13:58.284788435 +0000 UTC m=+0.866427797 container remove 07ffb97112ebe9bf0cba68135a8caecce4557f34429ade6eb8701f953cf43483 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-19e2a2b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-17T09:13:58.307 DEBUG:teuthology.orchestra.run.smithi179:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@osd.2.service' 2024-09-17T09:13:58.346 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:13:58.346 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-17T09:13:58.346 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-09-17T09:13:58.347 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@rgw.foo.a 2024-09-17T09:13:58.703 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:13:58 smithi042 systemd[1]: Stopping Ceph rgw.foo.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:13:59.474 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:13:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a[41041]: 2024-09-17T09:13:59.159+0000 7f22a4d6c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-17T09:13:59.474 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:13:59 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a[41041]: 2024-09-17T09:13:59.159+0000 7f22a85d7880 -1 shutting down 2024-09-17T09:14:09.458 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:14:09 smithi042 bash[52806]: time="2024-09-17T09:14:09Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-09-17T09:14:09.458 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:14:09 smithi042 podman[52806]: 2024-09-17 09:14:09.18584258 +0000 UTC m=+10.355360462 container died f21157d9d39fe1497be244660c6f9a7c6077c1dde03373d0f4b2eb68ac37c0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-17T09:14:09.974 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:14:09 smithi042 podman[52806]: 2024-09-17 09:14:09.715755683 +0000 UTC m=+10.885273601 container cleanup f21157d9d39fe1497be244660c6f9a7c6077c1dde03373d0f4b2eb68ac37c0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a, ceph=True, org.label-schema.license=GPLv2, RELEASE=reef-19e2a2b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T09:14:09.974 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:14:09 smithi042 bash[52806]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a 2024-09-17T09:14:09.974 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:14:09 smithi042 podman[52853]: 2024-09-17 09:14:09.900227237 +0000 UTC m=+0.713385723 container remove f21157d9d39fe1497be244660c6f9a7c6077c1dde03373d0f4b2eb68ac37c0ae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:70b7810862ffedc21315a6c67a84878d4bbd16155279a41a670f6f6be7488da9, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-rgw-foo-a, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=reef-19e2a2b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-17T09:14:09.974 INFO:journalctl@ceph.rgw.foo.a.smithi042.stdout:Sep 17 09:14:09 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@rgw.foo.a.service: Main process exited, code=exited, status=137/n/a 2024-09-17T09:14:10.165 DEBUG:teuthology.orchestra.run.smithi042:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@rgw.foo.a.service' 2024-09-17T09:14:10.202 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:14:10.202 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-09-17T09:14:10.203 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-09-17T09:14:10.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ceph-3dd20088-74d4-11ef-bceb-c7b262605968@prometheus.a 2024-09-17T09:14:10.490 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 systemd[1]: Stopping Ceph prometheus.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:14:10.756 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.489Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-09-17T09:14:10.756 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.489Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-09-17T09:14:10.756 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.489Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-09-17T09:14:10.756 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.489Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-09-17T09:14:10.756 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.489Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-09-17T09:14:10.756 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.489Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-09-17T09:14:10.757 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.490Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-09-17T09:14:10.757 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.490Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-09-17T09:14:10.757 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.490Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-09-17T09:14:10.757 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.490Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-09-17T09:14:10.757 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.490Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-09-17T09:14:10.757 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a[35909]: ts=2024-09-17T09:14:10.490Z caller=main.go:1147 level=info msg="See you next time!" 2024-09-17T09:14:10.757 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 podman[47436]: 2024-09-17 09:14:10.50026271 +0000 UTC m=+0.100564733 container died 16468f82e75243bddabfbdc181f8be93dbe451dd5bfa7a224d0c5b7c7e11d0ee (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:11.018 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 podman[47436]: 2024-09-17 09:14:10.854374105 +0000 UTC m=+0.454676132 container cleanup 16468f82e75243bddabfbdc181f8be93dbe451dd5bfa7a224d0c5b7c7e11d0ee (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:11.018 INFO:journalctl@ceph.prometheus.a.smithi161.stdout:Sep 17 09:14:10 smithi161 bash[47436]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-prometheus-a 2024-09-17T09:14:11.300 DEBUG:teuthology.orchestra.run.smithi161:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3dd20088-74d4-11ef-bceb-c7b262605968@prometheus.a.service' 2024-09-17T09:14:11.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-17T09:14:11.338 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-09-17T09:14:11.339 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T09:14:11.496 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:14:12.724 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:12 smithi042 systemd[1]: Stopping Ceph alertmanager.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:14:13.163 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:12 smithi042 ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a[46472]: ts=2024-09-17T09:14:12.797Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-09-17T09:14:13.163 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:12 smithi042 podman[53185]: 2024-09-17 09:14:12.818371564 +0000 UTC m=+0.167534513 container died cd569a324b62218d237f20c0e757b2d05cc46b0727d6ffc26c88d59261d445b3 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:13.163 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:13 smithi042 podman[53185]: 2024-09-17 09:14:13.16276025 +0000 UTC m=+0.511923240 container cleanup cd569a324b62218d237f20c0e757b2d05cc46b0727d6ffc26c88d59261d445b3 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:13.474 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:13 smithi042 bash[53185]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a 2024-09-17T09:14:13.474 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:13 smithi042 podman[53202]: 2024-09-17 09:14:13.330618561 +0000 UTC m=+0.509852618 container remove cd569a324b62218d237f20c0e757b2d05cc46b0727d6ffc26c88d59261d445b3 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:13.474 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:13 smithi042 podman[53202]: 2024-09-17 09:14:13.406146434 +0000 UTC m=+0.585380449 volume remove 0fff765de16499b2baf1159a6609a65299c621232173efabafcaef93ca0c95a5 2024-09-17T09:14:13.974 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:13 smithi042 systemd[1]: Stopping Ceph node-exporter.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:14:13.974 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:13 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-09-17T09:14:13.974 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:13 smithi042 systemd[1]: Stopped Ceph alertmanager.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:14:13.974 INFO:journalctl@ceph.alertmanager.a.smithi042.stdout:Sep 17 09:14:13 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@alertmanager.a.service: Consumed 1.109s CPU time. 2024-09-17T09:14:14.474 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:14 smithi042 podman[53315]: 2024-09-17 09:14:14.104929058 +0000 UTC m=+0.114308564 container died 934ead8d53cf075e2ffff1477d0c496b82fba6c861768affe13f3c3a9c036cf9 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:14.935 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:14 smithi042 podman[53315]: 2024-09-17 09:14:14.650543547 +0000 UTC m=+0.659923053 container cleanup 934ead8d53cf075e2ffff1477d0c496b82fba6c861768affe13f3c3a9c036cf9 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:14.935 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:14 smithi042 bash[53315]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a 2024-09-17T09:14:15.224 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:14 smithi042 podman[53332]: 2024-09-17 09:14:14.934978357 +0000 UTC m=+0.833914654 container remove 934ead8d53cf075e2ffff1477d0c496b82fba6c861768affe13f3c3a9c036cf9 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-09-17T09:14:15.224 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:14 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-09-17T09:14:15.224 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:15 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-09-17T09:14:15.224 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:15 smithi042 systemd[1]: Stopped Ceph node-exporter.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:14:15.224 INFO:journalctl@ceph.node-exporter.a.smithi042.stdout:Sep 17 09:14:15 smithi042 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.a.service: Consumed 1.894s CPU time. 2024-09-17T09:14:15.761 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T09:14:16.084 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:14:17.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:17 smithi161 systemd[1]: Stopping Ceph grafana.a for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:14:17.611 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:17 smithi161 podman[48390]: 2024-09-17 09:14:17.331589595 +0000 UTC m=+0.112052267 container died 881c3bec8dc039cdba5e89684c39c9775d801c358e003b5af15dd839b2e76c42 (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, maintainer=Paul Cuzner , architecture=x86_64, build-date=2022-04-29T11:48:11.055897, release=239.1651231664, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vcs-type=git, distribution-scope=public, description=Ceph Grafana Container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base rhel8, io.buildah.version=1.32.0, name=ubi8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container) 2024-09-17T09:14:17.944 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:17 smithi161 podman[48390]: 2024-09-17 09:14:17.693162104 +0000 UTC m=+0.473624785 container cleanup 881c3bec8dc039cdba5e89684c39c9775d801c358e003b5af15dd839b2e76c42 (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a, release=239.1651231664, summary=Grafana Container configured for Ceph mgr/dashboard integration, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, vendor=Red Hat, Inc., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.buildah.version=1.32.0, maintainer=Paul Cuzner , architecture=x86_64, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container, build-date=2022-04-29T11:48:11.055897, distribution-scope=public, io.openshift.tags=base rhel8, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, name=ubi8, description=Ceph Grafana Container, version=8.5) 2024-09-17T09:14:17.945 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:17 smithi161 bash[48390]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a 2024-09-17T09:14:18.268 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:17 smithi161 podman[48409]: 2024-09-17 09:14:17.944578841 +0000 UTC m=+0.611026203 container remove 881c3bec8dc039cdba5e89684c39c9775d801c358e003b5af15dd839b2e76c42 (image=quay.io/ceph/ceph-grafana:9.4.7, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-grafana-a, io.buildah.version=1.32.0, description=Ceph Grafana Container, vendor=Red Hat, Inc., summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, release=239.1651231664, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , distribution-scope=public, vcs-type=git, architecture=x86_64, version=8.5, com.redhat.component=ubi8-container, name=ubi8, build-date=2022-04-29T11:48:11.055897, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, io.openshift.tags=base rhel8) 2024-09-17T09:14:18.268 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:17 smithi161 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-09-17T09:14:18.268 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:18 smithi161 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@grafana.a.service: Failed with result 'exit-code'. 2024-09-17T09:14:18.268 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:18 smithi161 systemd[1]: Stopped Ceph grafana.a for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:14:18.269 INFO:journalctl@ceph.grafana.a.smithi161.stdout:Sep 17 09:14:18 smithi161 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@grafana.a.service: Consumed 4.357s CPU time. 2024-09-17T09:14:18.768 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:18 smithi161 systemd[1]: Stopping Ceph node-exporter.b for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:14:18.768 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:18 smithi161 podman[48520]: 2024-09-17 09:14:18.551811335 +0000 UTC m=+0.110406215 container died 5f41a47386b2d4d0d0132e91ccc75be022ef991e215df585d93353099da950ad (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T09:14:19.073 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:18 smithi161 podman[48520]: 2024-09-17 09:14:18.880433827 +0000 UTC m=+0.439028696 container cleanup 5f41a47386b2d4d0d0132e91ccc75be022ef991e215df585d93353099da950ad (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T09:14:19.073 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:18 smithi161 bash[48520]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b 2024-09-17T09:14:19.459 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:19 smithi161 podman[48537]: 2024-09-17 09:14:19.072994002 +0000 UTC m=+0.525290080 container remove 5f41a47386b2d4d0d0132e91ccc75be022ef991e215df585d93353099da950ad (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-09-17T09:14:19.647 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:19 smithi161 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-09-17T09:14:19.647 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:19 smithi161 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-09-17T09:14:19.648 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:19 smithi161 systemd[1]: Stopped Ceph node-exporter.b for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:14:19.648 INFO:journalctl@ceph.node-exporter.b.smithi161.stdout:Sep 17 09:14:19 smithi161 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.b.service: Consumed 1.826s CPU time. 2024-09-17T09:14:19.929 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-17T09:14:20.087 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:14:21.029 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:20 smithi179 systemd[1]: Stopping Ceph node-exporter.c for 3dd20088-74d4-11ef-bceb-c7b262605968... 2024-09-17T09:14:21.480 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 podman[47041]: 2024-09-17 09:14:21.208500926 +0000 UTC m=+0.130960318 container died 5f0766b0b7454199b3f1825119542d72cc18cdd0e7d6f106bb930a35fb509e3b (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c, maintainer=The Prometheus Authors ) 2024-09-17T09:14:21.779 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 podman[47041]: 2024-09-17 09:14:21.588207538 +0000 UTC m=+0.510666915 container cleanup 5f0766b0b7454199b3f1825119542d72cc18cdd0e7d6f106bb930a35fb509e3b (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c, maintainer=The Prometheus Authors ) 2024-09-17T09:14:21.779 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 bash[47041]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c 2024-09-17T09:14:22.114 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 podman[47058]: 2024-09-17 09:14:21.814486891 +0000 UTC m=+0.610146921 container remove 5f0766b0b7454199b3f1825119542d72cc18cdd0e7d6f106bb930a35fb509e3b (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-3dd20088-74d4-11ef-bceb-c7b262605968-node-exporter-c, maintainer=The Prometheus Authors ) 2024-09-17T09:14:22.114 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.c.service: Main process exited, code=exited, status=143/n/a 2024-09-17T09:14:22.114 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.c.service: Failed with result 'exit-code'. 2024-09-17T09:14:22.114 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 systemd[1]: Stopped Ceph node-exporter.c for 3dd20088-74d4-11ef-bceb-c7b262605968. 2024-09-17T09:14:22.114 INFO:journalctl@ceph.node-exporter.c.smithi179.stdout:Sep 17 09:14:21 smithi179 systemd[1]: ceph-3dd20088-74d4-11ef-bceb-c7b262605968@node-exporter.c.service: Consumed 1.873s CPU time. 2024-09-17T09:14:22.592 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:14:22.626 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:14:22.659 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-17T09:14:22.687 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-17T09:14:22.689 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi042/crash 2024-09-17T09:14:22.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash -- . 2024-09-17T09:14:22.735 INFO:teuthology.orchestra.run.smithi042.stderr:tar: /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T09:14:22.736 INFO:teuthology.orchestra.run.smithi042.stderr:tar: Error is not recoverable: exiting now 2024-09-17T09:14:22.738 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi161/crash 2024-09-17T09:14:22.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash -- . 2024-09-17T09:14:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:tar: /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T09:14:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:tar: Error is not recoverable: exiting now 2024-09-17T09:14:22.824 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi179/crash 2024-09-17T09:14:22.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash -- . 2024-09-17T09:14:22.861 INFO:teuthology.orchestra.run.smithi179.stderr:tar: /var/lib/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-17T09:14:22.861 INFO:teuthology.orchestra.run.smithi179.stderr:tar: Error is not recoverable: exiting now 2024-09-17T09:14:22.862 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-17T09:14:22.862 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v CEPHADM_AGENT_DOWN | egrep -v CEPHADM_FAILED_DAEMON | head -n 1 2024-09-17T09:14:22.893 INFO:teuthology.orchestra.run.smithi042.stderr:grep: /var/log/ceph/3dd20088-74d4-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-17T09:14:22.895 INFO:tasks.cephadm:Compressing logs... 2024-09-17T09:14:22.895 DEBUG:teuthology.orchestra.run.smithi042:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:14:22.938 DEBUG:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:14:22.941 DEBUG:teuthology.orchestra.run.smithi179:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:14:22.963 INFO:teuthology.orchestra.run.smithi161.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-17T09:14:22.965 INFO:teuthology.orchestra.run.smithi179.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-17T09:14:22.965 INFO:teuthology.orchestra.run.smithi042.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-17T09:14:23.688 INFO:tasks.cephadm:Archiving logs... 2024-09-17T09:14:23.689 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi042/log 2024-09-17T09:14:23.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T09:14:23.841 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi161/log 2024-09-17T09:14:23.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T09:14:23.922 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi179/log 2024-09-17T09:14:23.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T09:14:23.995 INFO:tasks.cephadm:Removing cluster... 2024-09-17T09:14:23.996 DEBUG:teuthology.orchestra.run.smithi042:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 --force 2024-09-17T09:14:24.140 INFO:teuthology.orchestra.run.smithi042.stdout:Deleting cluster with fsid: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:14:24.279 DEBUG:teuthology.orchestra.run.smithi161:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 --force 2024-09-17T09:14:24.418 INFO:teuthology.orchestra.run.smithi161.stdout:Deleting cluster with fsid: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:14:24.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3dd20088-74d4-11ef-bceb-c7b262605968 --force 2024-09-17T09:14:24.702 INFO:teuthology.orchestra.run.smithi179.stdout:Deleting cluster with fsid: 3dd20088-74d4-11ef-bceb-c7b262605968 2024-09-17T09:14:24.834 INFO:tasks.cephadm:Removing cephadm ... 2024-09-17T09:14:24.834 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T09:14:24.852 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T09:14:24.868 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-17T09:14:24.884 INFO:tasks.cephadm:Teardown complete 2024-09-17T09:14:24.884 DEBUG:teuthology.run_tasks:Unwinding manager nvme_loop 2024-09-17T09:14:24.896 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi042:/dev/vg_nvme/lv_1... 2024-09-17T09:14:24.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo nvme disconnect -n lv_1 2024-09-17T09:14:25.045 INFO:teuthology.orchestra.run.smithi042.stdout:NQN:lv_1 disconnected 1 controller(s) 2024-09-17T09:14:25.046 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi042:/dev/vg_nvme/lv_2... 2024-09-17T09:14:25.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo nvme disconnect -n lv_2 2024-09-17T09:14:25.207 INFO:teuthology.orchestra.run.smithi042.stdout:NQN:lv_2 disconnected 1 controller(s) 2024-09-17T09:14:25.209 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi042:/dev/vg_nvme/lv_3... 2024-09-17T09:14:25.209 DEBUG:teuthology.orchestra.run.smithi042:> sudo nvme disconnect -n lv_3 2024-09-17T09:14:25.363 INFO:teuthology.orchestra.run.smithi042.stdout:NQN:lv_3 disconnected 1 controller(s) 2024-09-17T09:14:25.365 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi042:/dev/vg_nvme/lv_4... 2024-09-17T09:14:25.365 DEBUG:teuthology.orchestra.run.smithi042:> sudo nvme disconnect -n lv_4 2024-09-17T09:14:25.502 INFO:teuthology.orchestra.run.smithi042.stdout:NQN:lv_4 disconnected 1 controller(s) 2024-09-17T09:14:25.504 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-09-17T09:14:25.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/scratch_devs 2024-09-17T09:14:25.530 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi161:/dev/vg_nvme/lv_1... 2024-09-17T09:14:25.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo nvme disconnect -n lv_1 2024-09-17T09:14:25.702 INFO:teuthology.orchestra.run.smithi161.stdout:NQN:lv_1 disconnected 1 controller(s) 2024-09-17T09:14:25.704 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi161:/dev/vg_nvme/lv_2... 2024-09-17T09:14:25.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo nvme disconnect -n lv_2 2024-09-17T09:14:25.863 INFO:teuthology.orchestra.run.smithi161.stdout:NQN:lv_2 disconnected 1 controller(s) 2024-09-17T09:14:25.865 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi161:/dev/vg_nvme/lv_3... 2024-09-17T09:14:25.866 DEBUG:teuthology.orchestra.run.smithi161:> sudo nvme disconnect -n lv_3 2024-09-17T09:14:26.022 INFO:teuthology.orchestra.run.smithi161.stdout:NQN:lv_3 disconnected 1 controller(s) 2024-09-17T09:14:26.024 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi161:/dev/vg_nvme/lv_4... 2024-09-17T09:14:26.024 DEBUG:teuthology.orchestra.run.smithi161:> sudo nvme disconnect -n lv_4 2024-09-17T09:14:26.176 INFO:teuthology.orchestra.run.smithi161.stdout:NQN:lv_4 disconnected 1 controller(s) 2024-09-17T09:14:26.177 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-09-17T09:14:26.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/scratch_devs 2024-09-17T09:14:26.205 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi179:/dev/vg_nvme/lv_1... 2024-09-17T09:14:26.206 DEBUG:teuthology.orchestra.run.smithi179:> sudo nvme disconnect -n lv_1 2024-09-17T09:14:26.373 INFO:teuthology.orchestra.run.smithi179.stdout:NQN:lv_1 disconnected 1 controller(s) 2024-09-17T09:14:26.375 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi179:/dev/vg_nvme/lv_2... 2024-09-17T09:14:26.375 DEBUG:teuthology.orchestra.run.smithi179:> sudo nvme disconnect -n lv_2 2024-09-17T09:14:26.521 INFO:teuthology.orchestra.run.smithi179.stdout:NQN:lv_2 disconnected 1 controller(s) 2024-09-17T09:14:26.523 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi179:/dev/vg_nvme/lv_3... 2024-09-17T09:14:26.523 DEBUG:teuthology.orchestra.run.smithi179:> sudo nvme disconnect -n lv_3 2024-09-17T09:14:26.686 INFO:teuthology.orchestra.run.smithi179.stdout:NQN:lv_3 disconnected 1 controller(s) 2024-09-17T09:14:26.688 INFO:tasks.nvme_loop:Disconnecting nvme_loop smithi179:/dev/vg_nvme/lv_4... 2024-09-17T09:14:26.688 DEBUG:teuthology.orchestra.run.smithi179:> sudo nvme disconnect -n lv_4 2024-09-17T09:14:26.851 INFO:teuthology.orchestra.run.smithi179.stdout:NQN:lv_4 disconnected 1 controller(s) 2024-09-17T09:14:26.853 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-09-17T09:14:26.853 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/scratch_devs 2024-09-17T09:14:26.882 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T09:14:26.890 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T09:14:26.890 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:14:26.893 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:14:26.896 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T09:14:26.909 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-09-17T09:14:26.911 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-09-17T09:14:26.914 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T09:14:26.914 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-09-17T09:14:26.914 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 46 -115us[ -116us] +/- 41ms 2024-09-17T09:14:26.914 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -1259us[-1260us] +/- 45ms 2024-09-17T09:14:26.914 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +2152us[+2151us] +/- 65ms 2024-09-17T09:14:26.914 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:14:26.916 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T09:14:26.916 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-09-17T09:14:26.916 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 48 -101us[ -86us] +/- 41ms 2024-09-17T09:14:26.916 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -1254us[-1239us] +/- 45ms 2024-09-17T09:14:26.916 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +2171us[+2171us] +/- 65ms 2024-09-17T09:14:26.916 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:14:26.938 INFO:teuthology.orchestra.run.smithi179.stderr:bash: line 1: ntpq: command not found 2024-09-17T09:14:26.944 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T09:14:26.944 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2024-09-17T09:14:26.944 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 46 -106us[ -106us] +/- 41ms 2024-09-17T09:14:26.944 INFO:teuthology.orchestra.run.smithi179.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -1253us[-1247us] +/- 45ms 2024-09-17T09:14:26.944 INFO:teuthology.orchestra.run.smithi179.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +2158us[+2158us] +/- 65ms 2024-09-17T09:14:26.944 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T09:14:26.945 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T09:14:26.953 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T09:14:26.954 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T09:14:26.986 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T09:14:27.067 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T09:14:27.141 DEBUG:teuthology.orchestra.run.smithi179:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T09:14:27.215 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T09:14:27.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:14:27.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T09:14:27.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:14:27.277 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T09:14:27.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:14:27.308 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T09:14:27.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T09:14:27.329 INFO:teuthology.task.internal:Duration was 670.755482 seconds 2024-09-17T09:14:27.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T09:14:27.346 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T09:14:27.346 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T09:14:27.348 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T09:14:27.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T09:14:27.389 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T09:14:27.389 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T09:14:27.392 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T09:14:27.811 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T09:14:27.811 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-09-17T09:14:27.811 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T09:14:27.834 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-09-17T09:14:27.835 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T09:14:27.875 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-09-17T09:14:27.876 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T09:14:27.914 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T09:14:27.915 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:14:27.917 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:14:27.919 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T09:14:27.983 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T09:14:27.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T09:14:27.988 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T09:14:27.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T09:14:28.190 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T09:14:28.200 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T09:14:28.200 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T09:14:28.225 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T09:14:28.250 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T09:14:28.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T09:14:28.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:14:28.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:14:28.293 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:14:28.309 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-09-17T09:14:28.313 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-09-17T09:14:28.338 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-09-17T09:14:28.358 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:14:28.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:14:28.389 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:14:28.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:14:28.403 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T09:14:28.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T09:14:28.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T09:14:28.427 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T09:14:28.428 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi042 2024-09-17T09:14:28.429 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T09:14:28.467 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi161 2024-09-17T09:14:28.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T09:14:28.501 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-16_22:08:02-orch-reef-distro-default-smithi/7908271/remote/smithi179 2024-09-17T09:14:28.502 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T09:14:28.535 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T09:14:28.536 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T09:14:28.538 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T09:14:28.540 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T09:14:28.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T09:14:28.595 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T09:14:28.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T09:14:28.634 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T09:14:28.634 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T09:14:28.636 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T09:14:28.639 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T09:14:28.649 INFO:teuthology.orchestra.run.smithi042.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 09:14 /home/ubuntu/cephtest 2024-09-17T09:14:28.651 INFO:teuthology.orchestra.run.smithi161.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 09:14 /home/ubuntu/cephtest 2024-09-17T09:14:28.653 INFO:teuthology.orchestra.run.smithi179.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 09:14 /home/ubuntu/cephtest 2024-09-17T09:14:28.655 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T09:14:28.664 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T09:14:28.706 INFO:teuthology.run:Summary data: description: orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} duration: 670.7554817199707 owner: scheduled_teuthology@teuthology success: true 2024-09-17T09:14:28.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T09:14:28.787 INFO:teuthology.run:pass